-- Logs begin at Tue 2022-10-18 23:51:38 UTC, end at Wed 2022-10-19 00:56:13 UTC. -- Oct 19 00:25:42.103228 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 19 00:25:42.111098 dv-cinder-master-3-smb devstack@keystone.service[81708]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:25:42 2022] *** Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: nodename: dv-cinder-master-3-smb Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: machine: x86_64 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: clock source: unix Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: pcre jit disabled Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: detected number of CPU cores: 4 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: current working directory: / Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: your processes number limit is 47680 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: your memory page size is 4096 bytes Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: detected max file descriptor number: 2048 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: lock engine: pthread robust mutexes Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: thunder lock: enabled Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 19 00:25:42.115171 dv-cinder-master-3-smb devstack@keystone.service[81708]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:25:42.155017 dv-cinder-master-3-smb devstack@keystone.service[81708]: Python main interpreter initialized at 0x55c13810c9c0 Oct 19 00:25:42.155017 dv-cinder-master-3-smb devstack@keystone.service[81708]: python threads support enabled Oct 19 00:25:42.155017 dv-cinder-master-3-smb devstack@keystone.service[81708]: your server socket listen backlog is limited to 100 connections Oct 19 00:25:42.155017 dv-cinder-master-3-smb devstack@keystone.service[81708]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:25:42.155409 dv-cinder-master-3-smb devstack@keystone.service[81708]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:25:42.155490 dv-cinder-master-3-smb devstack@keystone.service[81708]: *** Operational MODE: preforking *** Oct 19 00:25:42.155714 dv-cinder-master-3-smb devstack@keystone.service[81708]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:25:42.155714 dv-cinder-master-3-smb devstack@keystone.service[81708]: spawned uWSGI master process (pid: 81708) Oct 19 00:25:42.155937 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 19 00:25:42.159900 dv-cinder-master-3-smb devstack@keystone.service[81708]: spawned uWSGI worker 1 (pid: 81722, cores: 1) Oct 19 00:25:42.159900 dv-cinder-master-3-smb devstack@keystone.service[81708]: spawned uWSGI worker 2 (pid: 81723, cores: 1) Oct 19 00:25:42.159900 dv-cinder-master-3-smb devstack@keystone.service[81708]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:25:46.449410 dv-cinder-master-3-smb devstack@keystone.service[81722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:25:46.449410 dv-cinder-master-3-smb devstack@keystone.service[81722]: from cryptography.utils import int_from_bytes Oct 19 00:25:46.450203 dv-cinder-master-3-smb devstack@keystone.service[81722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:25:46.450203 dv-cinder-master-3-smb devstack@keystone.service[81722]: from cryptography.utils import int_from_bytes Oct 19 00:25:46.450324 dv-cinder-master-3-smb devstack@keystone.service[81723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:25:46.450324 dv-cinder-master-3-smb devstack@keystone.service[81723]: from cryptography.utils import int_from_bytes Oct 19 00:25:46.450324 dv-cinder-master-3-smb devstack@keystone.service[81723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:25:46.450324 dv-cinder-master-3-smb devstack@keystone.service[81723]: from cryptography.utils import int_from_bytes Oct 19 00:25:46.500792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:25:46.500958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:25:46.501066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:25:46.501160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:25:46.501242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] command line args: [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:25:46.501321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] command line args: [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:25:46.501422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:25:46.501515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:25:46.501588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ================================================================================ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:25:46.501665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ================================================================================ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:25:46.501842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] admin_token = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.501921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] admin_token = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_dir = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_dir = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_source = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_source = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] debug = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] debug = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.502846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.503985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_config_append = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_config_append = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_dir = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_dir = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.504911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.505965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.506965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507435 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.507989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] publish_errors = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.508863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] publish_errors = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.509980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] standard_threads = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] standard_threads = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.510929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_journal = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_journal = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_json = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_json = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_stderr = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_stderr = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_syslog = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.511983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.512129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_syslog = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.512207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:25:46.512346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.512916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.513885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.514846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.515990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.516955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.517929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.518930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.519892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.520990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521448 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.521985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.522892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.523993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.524924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.525943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526538 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.526619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.527993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.528931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529433 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.529982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.530929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.531941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532344 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.532964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.533994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.534957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535082 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.535884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.536914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.537943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.external = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.external = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538436 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.password = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.token = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.538956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.password = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.token = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.539925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.540884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.541998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.542077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.542239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.542325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.543961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.544879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.545921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.546949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.547880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.548908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.549887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550575 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.550956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.551955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552575 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.552847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.553944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.554795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.555838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.556960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557096 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.557873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.558901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.559952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.560982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.561875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.562895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.563962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.564994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.565891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566655 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.566916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.567957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.568956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.569941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.570980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571057 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.571933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572575 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.572984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.573995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.574895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.575845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.576876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577502 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.577970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.578918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.579954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.580899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.581863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.582957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.583951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.584929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.585944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.586874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.587987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:25:46.588475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.588909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:25:46.589077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:25:46.619091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.619324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.619421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.619552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.619638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.619839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.628364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.628467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.656982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.657147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.657235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.657375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.711274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.712288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.760786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.761012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.761690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.761926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.919932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.920010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.920085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.920173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.920281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.920366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.943539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.943712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.943804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.943969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944412 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.944918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.945044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.956693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.956839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.969500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.969613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.969703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.969822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.969907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.970900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:25:46.988190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.988396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:25:46.988735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.988816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.988932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:25:46.989030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:25:46.989209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.989339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.989470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.989551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:25:46.989727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.989810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.989981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.990062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.990289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:46.990548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.000268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.000546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.000818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.000901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.001103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.001200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.001408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.001689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.008137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.008699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.011047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.011450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.011749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.011930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.012053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.012964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.013953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.014034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.014226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.014498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.036565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.037377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.038028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.038312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.038843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.039130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.043565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.043844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.044145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.044450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.044736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.045019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.050510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.050793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.051363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.051652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.056399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.056695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.056984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.057273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.057354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.057553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.057636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.057830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.057912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.058660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.058797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.058935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.059020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.059214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.059483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.059750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.074643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.074918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.075437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.075719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.078787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.079598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.082041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.082341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.082865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.083163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.086550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.087402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.089916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.090618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.093238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.093541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.093828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.093910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.094973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.095265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.111260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.111550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.111817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.111920 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.112105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.112204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.112410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.112675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.118904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.119588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.120516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.121728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.122734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.123011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.123255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.123536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.125665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.125958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.126238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.126320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.126520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.126616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.126821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.126904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.127103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.127499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.138505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.138684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.138798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.138976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.139945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.140043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.140242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.140324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.140523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.155762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.155987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.158682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.158895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.161579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.161827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.163189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.163305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.164692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.164807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.164988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.165096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.165384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.165496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.172305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.172653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.173772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.174126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.176670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.177987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.186082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.186374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.186559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.186644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.186854 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.187139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.193518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.193815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:25:47.194129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.194968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.195978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.196877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.197050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.197133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.197324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.197609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:25:47.232573 dv-cinder-master-3-smb devstack@keystone.service[81722]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c13810c9c0 pid: 81722 (default app) Oct 19 00:25:47.233074 dv-cinder-master-3-smb devstack@keystone.service[81723]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c13810c9c0 pid: 81723 (default app) Oct 19 00:25:47.235790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9d0a-3a45-40f9-bcd8-4b083f07ab12 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:47.236103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9d0a-3a45-40f9-bcd8-4b083f07ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:47.236376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9d0a-3a45-40f9-bcd8-4b083f07ab12 None None] PATH_INFO: `/v3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:47.240522 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Wed Oct 19 00:25:47 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:54.140297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:54.140900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:54.140900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:54.145062 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:25:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:54.150835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:54.151295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:54.151440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:54.221431 dv-cinder-master-3-smb devstack@keystone.service[81722]: INFO dbcounter [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] Registered counter for database keystone Oct 19 00:25:54.240703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:25:54.247328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writer thread running {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:25:54.425327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG passlib.handlers.bcrypt [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81722) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:25:54.425621 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG passlib.handlers.bcrypt [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81722) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:25:54.483623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:54.485238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:54.613027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:25:55.079720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:55.149429 dv-cinder-master-3-smb devstack@keystone.service[81723]: INFO dbcounter [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] Registered counter for database keystone Oct 19 00:25:55.171016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG oslo_db.sqlalchemy.engines [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:25:55.177275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writer thread running {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:25:55.294941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205acb28-fb33-4e80-9c6a-c0b424d9b182 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:55.299120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:55.299731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:55.300031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:55.300301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:55.308806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:55.360609 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:25:55.360886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3d63-0034-442f-972b-10af031f612d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:55.370089 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Oct 19 00:25:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:25:55.376210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:55.393703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c11d97-203d-4997-a781-b877a16b0cbe None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:55.398073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:55.399184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:55.399469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:55.399744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] PATH_INFO: `/v3/projects/303c1157509f409d8afed7ca58b4e513` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:55.401356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] RBAC: Authorizing `identity:get_project(project_id=303c1157509f409d8afed7ca58b4e513)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:55.456048 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:25:55.456401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00febb04-c4d5-499d-92d6-4514e760ec27 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:55.460907 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:25:55 2022] GET /identity/v3/projects/303c1157509f409d8afed7ca58b4e513 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:25:57.578449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4260-6701-46f8-beab-457ea06f9729 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:57.578970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4260-6701-46f8-beab-457ea06f9729 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:57.578970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4260-6701-46f8-beab-457ea06f9729 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:57.583056 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:25:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:57.588372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:57.588849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:57.588974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:57.609454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:57.610956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:57.618756 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:25:57.888099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4260-6701-46f8-beab-457ea06f9729 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:57.900072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4260-6701-46f8-beab-457ea06f9729 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:57.904535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:57.905123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:57.905401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:57.905674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:57.913193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:57.914954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37bec3-3c9f-45ca-b391-553dbfdd75ea admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:57.923743 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Oct 19 00:25:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:25:57.928917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:57.938790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc488d-d508-47ee-84be-6daa92efc5ab None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:57.943055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:57.943670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:57.943980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:57.944252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] PATH_INFO: `/v3/users/ce8ca093fadc4e9da3bc39e824be9781` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:57.945540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce8ca093fadc4e9da3bc39e824be9781)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:57.947335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3916-390b-4fbd-8776-60878e5bf101 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:57.949469 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Wed Oct 19 00:25:57 2022] GET /identity/v3/users/ce8ca093fadc4e9da3bc39e824be9781 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:00.130183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321936-a8c6-4ab0-97ec-e1789746236c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.130741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321936-a8c6-4ab0-97ec-e1789746236c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.130741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321936-a8c6-4ab0-97ec-e1789746236c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.132074 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:00.137385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.137791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.137948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.156589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:00.157780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:00.188217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8cf0-1ef6-436e-b78c-81e94e2e9673 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.188498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8cf0-1ef6-436e-b78c-81e94e2e9673 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.188770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8cf0-1ef6-436e-b78c-81e94e2e9673 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.190090 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:00.195293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.195613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.195915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.238787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG passlib.handlers.bcrypt [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81723) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:26:00.239184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG passlib.handlers.bcrypt [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81723) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:26:00.239629 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:00.288262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:00.289848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:00.389161 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:00.506467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.530817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:00.610483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b5ec-cdb3-4e14-9052-446bca520750 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:00.644165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:00.644719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.645002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.645279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.657050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:00.658023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:00.666254 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:00.667421 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:00.668493 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:00.673312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.753698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:00.761480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4494-a65c-4587-bd6f-0ba5d30fe344 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:00.763747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:00.773875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20240fd-533c-4514-aa38-c032cc26a544 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:00.800675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:00.801533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.801811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.802080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.803031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:00.804499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:00.808515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:00.809120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.809400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.809670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.810337 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:00.810639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:00.812063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:00.815368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:26:00.815368 dv-cinder-master-3-smb devstack@keystone.service[81723]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:26:00.815368 dv-cinder-master-3-smb devstack@keystone.service[81723]: [parameters: {'id': 'c40752c12a2848559e1e0fb1115689fe', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:26:00.815368 dv-cinder-master-3-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:26:00.824882 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:00.830555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:26:00.834090 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:26:00.835041 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:26:00.836222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:26:00.837336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:26:00.838220 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:26:00.839614 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'id': 'c40752c12a2848559e1e0fb1115689fe', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:26:00.841398 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:00.842381 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 8/16] 10.222.0.33 () {60 vars in 1137 bytes} [Wed Oct 19 00:26:00 2022] POST /identity/v3/domains => generated 190 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:00.843473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.934543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049b043-20ff-4fe9-bae1-d23e7a155130 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:00.941890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653483e5-73d3-4b3f-8936-f4c6a354860d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:00.967810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:00.968480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.968755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.969023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] PATH_INFO: `/v3/users/ce8ca093fadc4e9da3bc39e824be9781` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.970154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] RBAC: Authorizing `identity:get_user(user_id=ce8ca093fadc4e9da3bc39e824be9781)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:00.971603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:00.973185 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:00 2022] GET /identity/v3/users/ce8ca093fadc4e9da3bc39e824be9781 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:00.975350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:00.976233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:00.976516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:00.976789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:00.978852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:00.993189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:00.995713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:00.997261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:01.014084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:01.015042 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:01.015841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:01.015841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:01.015841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:01.015841 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:01.021132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:01.043217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:01.082742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd75ee-5155-4830-a061-2bc59b169700 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:01.118216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:01.118832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:01.119108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:01.119373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:01.121628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:01.123055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:01.124604 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:01.126869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dda562-268c-4d38-a376-b06a3853cd39 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:01.130127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:01.160216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:01.160819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:01.161103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:01.161369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:01.162006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:01.162308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:01.163689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd36d-6930-4b10-8a75-4dc364a41355 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:01.181406 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:01.212586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:01.233795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859df1a-e312-48f6-9709-ca93d70c0a31 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:01.270278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:01.270954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:01.271233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:01.271505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] PATH_INFO: `/v3/domains/default/users/ce8ca093fadc4e9da3bc39e824be9781/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:01.273568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ce8ca093fadc4e9da3bc39e824be9781, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:01.275035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f83c-8bef-4edd-8b3c-34157c7d3817 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:01.390957 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1361 bytes} [Wed Oct 19 00:26:01 2022] PUT /identity/v3/domains/default/users/ce8ca093fadc4e9da3bc39e824be9781/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:03.650786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f6d2-bf83-4cdc-b6d1-27fd8b19b3f9 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:03.651828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f6d2-bf83-4cdc-b6d1-27fd8b19b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:03.652664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f6d2-bf83-4cdc-b6d1-27fd8b19b3f9 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:03.654265 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:03.660312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e15-8c06-454d-9b93-22ba90b9b12a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:03.661141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e15-8c06-454d-9b93-22ba90b9b12a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:03.661610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e15-8c06-454d-9b93-22ba90b9b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:03.684236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-07946e15-8c06-454d-9b93-22ba90b9b12a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:03.686289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07946e15-8c06-454d-9b93-22ba90b9b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:03.796683 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:03.815506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd13f-a31c-4340-be0e-907a737d79ff None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:03.816153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd13f-a31c-4340-be0e-907a737d79ff None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:03.816620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd13f-a31c-4340-be0e-907a737d79ff None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:03.818432 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:03.824152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58e086-ef10-49d2-a726-b04bf020ca05 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:03.824443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58e086-ef10-49d2-a726-b04bf020ca05 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:03.824720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58e086-ef10-49d2-a726-b04bf020ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:03.852344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0a58e086-ef10-49d2-a726-b04bf020ca05 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:03.853557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0a58e086-ef10-49d2-a726-b04bf020ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:03.942984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:03.947702 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:04.328735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b6cb-3a8e-4716-aefc-264ac269235b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.329387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b6cb-3a8e-4716-aefc-264ac269235b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.329855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b6cb-3a8e-4716-aefc-264ac269235b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.331473 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 13/26] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:04.346796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.347104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.347355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.369155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:04.370929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:04.422076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b6cb-3a8e-4716-aefc-264ac269235b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:04.457075 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:04.457957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:04.572641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:04.609497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b6cb-3a8e-4716-aefc-264ac269235b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:04.629483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31cef7-29f0-4421-ab7f-d393110d2b00 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:04.678213 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:04.680652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.681114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.682701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.683535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:04.685699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e08784-a0b8-4dee-8bcd-20d5874fa8dc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:04.692178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:04.697481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:04.698205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.698489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.698765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.720163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:04.722028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-886916b5-a805-42aa-87e3-38a788757769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:04.748386 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:04.749301 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:04.750141 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:04.750141 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:04.750141 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:04.754448 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 15/28] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:04.755710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb07c-e238-4a82-928d-658ea2f077cb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.756026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb07c-e238-4a82-928d-658ea2f077cb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.756303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb07c-e238-4a82-928d-658ea2f077cb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.760983 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 16/29] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:04.761724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb07c-e238-4a82-928d-658ea2f077cb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:04.847210 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 14/30] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Oct 19 00:26:04 2022] POST /identity/v3/roles => generated 219 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:26:04.850317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.850609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.850888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:04.892560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:04.894089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:04.917679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb07c-e238-4a82-928d-658ea2f077cb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:04.998683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:04.999313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:04.999595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:04.999886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.000557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:05.000863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:05.002292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:05.038117 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 15/32] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:05.039078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.042498 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 17/32] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:05.043819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.103353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:05.143169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:05.183080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0cf0-af35-4ae8-9696-2126f0cdfcd0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:05.222203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c7b30-c3a6-4a6a-ab5d-90b1cb97ed29 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:05.227692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:05.228355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.228630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.229822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.229822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:05.231270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:05.269726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:05.269922 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 16/33] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Oct 19 00:26:05 2022] POST /identity/v3/roles => generated 225 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:05.270425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.270976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.271346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.272148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:05.273726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b17661-65a6-443b-99ee-39cc6fafcb25 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:05.315654 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 18/34] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:26:05 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:05.368661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.522443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6877d-45bd-458a-b186-5fa8163ce8e6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:05.559043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed4-8cc4-4e8c-958a-124c70727f77 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.559691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed4-8cc4-4e8c-958a-124c70727f77 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.560183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed4-8cc4-4e8c-958a-124c70727f77 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.561834 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 19/35] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:05.566550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:05.568777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e301-26ed-4dbf-a12e-cb95225cc2a3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.569319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e301-26ed-4dbf-a12e-cb95225cc2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.569627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e301-26ed-4dbf-a12e-cb95225cc2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.576582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:05.577234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.577515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.577790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.593290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:05.599741 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:05.600952 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:05.601713 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:05.602284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5876e301-26ed-4dbf-a12e-cb95225cc2a3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:05.602353 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 17/36] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:05.602425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5876e301-26ed-4dbf-a12e-cb95225cc2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:05.613057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.696408 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 20/37] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:05.734029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3559-44d0-499b-a85c-66598eec9662 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.734455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3559-44d0-499b-a85c-66598eec9662 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.734650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3559-44d0-499b-a85c-66598eec9662 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.736045 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 21/38] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:05.741053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182783-0854-489e-8e56-4339ea61a715 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.741179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698c2d-9566-4987-a4b8-71e7c1684a4a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:05.741579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182783-0854-489e-8e56-4339ea61a715 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.741651 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182783-0854-489e-8e56-4339ea61a715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.760963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-81182783-0854-489e-8e56-4339ea61a715 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:05.762255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-81182783-0854-489e-8e56-4339ea61a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:05.777261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:05.777871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.778153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.778426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.779097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:05.779402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:05.780414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:05.780836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:05.795895 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 18/39] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:05.799102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.858528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:05.912137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884ce8-800f-4104-a428-a48e9b4c3c1f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:05.941603 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 22/40] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:05.948895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:05.949532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:05.949814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:05.950088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] PATH_INFO: `/v3/users/ce8ca093fadc4e9da3bc39e824be9781` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:05.951461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] RBAC: Authorizing `identity:get_user(user_id=ce8ca093fadc4e9da3bc39e824be9781)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:05.952960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:05.954668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 19/41] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:05 2022] GET /identity/v3/users/ce8ca093fadc4e9da3bc39e824be9781 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:05.959999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81182783-0854-489e-8e56-4339ea61a715 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:05.974501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:06.065491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81182783-0854-489e-8e56-4339ea61a715 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:06.084045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44b09-1416-41b5-9d09-dc2afebc639e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:06.098944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:06.099728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:06.100131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:06.100382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:06.101489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:06.102950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:06.104712 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 23/42] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:06.107187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:06.110473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:06.122485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:06.123090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:06.123368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:06.123644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:06.124339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:06.125708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:06.137128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:06.141205 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 20/43] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Oct 19 00:26:05 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:06.217947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:06.226476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5d92b-a699-48b5-934b-b00441df7aa9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:06.268586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:06.269212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:06.269504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:06.269761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:06.270506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.domain.id=default, user.id=ce8ca093fadc4e9da3bc39e824be9781) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:06.270808 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:06.272354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:06.281114 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 24/44] 10.222.0.33 () {56 vars in 1322 bytes} [Wed Oct 19 00:26:06 2022] GET /identity/v3/role_assignments?user.id=ce8ca093fadc4e9da3bc39e824be9781&scope.domain.id=default&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:06.347205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8cb29-a00a-422d-8abc-f4f644f6ac15 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:06.387570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:06.388272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:06.388550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:06.388820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:06.390010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:06.391483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9f6ba-74b7-4957-8c03-3a3ae504358a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:06.393116 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 21/45] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:06.399011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:06.489735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:06.504945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d361-b12d-476f-8c45-479fdf759fc9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:06.538552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:06.539152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:06.539431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:06.539697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:06.540374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:06.542057 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e93f-a7b6-4e72-b6c6-5e12f3aeae54 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:06.567367 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 25/46] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:26:06 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:08.733767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6862-7bf5-47cc-9b66-c1647152eb04 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:08.734268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6862-7bf5-47cc-9b66-c1647152eb04 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:08.734372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6862-7bf5-47cc-9b66-c1647152eb04 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:08.735656 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 22/47] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:08.740789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:08.741211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:08.741621 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:08.759487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:08.761409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:08.826166 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:09.095252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6862-7bf5-47cc-9b66-c1647152eb04 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:09.144838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:09.196576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6862-7bf5-47cc-9b66-c1647152eb04 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:09.229665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:09.230319 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:09.230660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:09.230945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:09.232229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:09.234111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1514acd-b1e6-4b0a-b745-9a39e984e3bf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:09.235775 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 23/49] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:09.241388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:09.305798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:09.338600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6208c-9a08-4557-91ef-d3197976e1fd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:09.372370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:09.372914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:09.373198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:09.373478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:09.374139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:09.375594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf9f2f-f0cf-46f0-801c-5ac6ea767855 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:09.400540 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 27/50] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Oct 19 00:26:09 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:11.536714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697346f-9384-44ba-9447-b3d10eecf4ba None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:11.537233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697346f-9384-44ba-9447-b3d10eecf4ba None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:11.537316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697346f-9384-44ba-9447-b3d10eecf4ba None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:11.538599 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 24/51] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:11.544603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:11.544983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:11.545155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:11.563945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:11.565123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:11.630937 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 28/52] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:11.906071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697346f-9384-44ba-9447-b3d10eecf4ba None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:12.004606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697346f-9384-44ba-9447-b3d10eecf4ba None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:12.020882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:12.038965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:12.039583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:12.039870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:12.040157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:12.041255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:12.044006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84bb20-dfe7-4c1f-9d4a-11220d6d6ff4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:12.045551 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:12.050998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:12.098889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:12.147843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa0743-d2a5-4d01-ae24-e57c399303f5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:12.181443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:12.181983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:12.182265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:12.182541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:12.183195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:12.184684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422333-5ca4-4546-9eea-4110978d816d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:12.210615 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 29/54] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:12 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:15.458298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5f26-f7ce-4676-b575-c181abda3ad4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.459291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5f26-f7ce-4676-b575-c181abda3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.459768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5f26-f7ce-4676-b575-c181abda3ad4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.461341 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 26/55] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:15.467295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0457c-86b1-45e4-81f3-ec98321658a6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.467697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0457c-86b1-45e4-81f3-ec98321658a6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.467913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0457c-86b1-45e4-81f3-ec98321658a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.482434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7592-6f59-4841-9b0c-4bf65672d2b0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.483052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7592-6f59-4841-9b0c-4bf65672d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.483581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7592-6f59-4841-9b0c-4bf65672d2b0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.485136 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 27/56] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:15.490521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.490953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e0d0457c-86b1-45e4-81f3-ec98321658a6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:15.491080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.491349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.492718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e0d0457c-86b1-45e4-81f3-ec98321658a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:15.522562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:15.524375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:15.626684 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 30/57] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:15.628262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d43-81c4-432f-ac8a-9e90e30db109 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.628768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d43-81c4-432f-ac8a-9e90e30db109 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.629191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d43-81c4-432f-ac8a-9e90e30db109 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.634547 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 31/58] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:15.636865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:15.637397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:15.637811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:15.648318 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 28/59] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:15.657474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:15.658946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:15.712044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:15.774407 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 32/60] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:15.917491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.023610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.064633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abbcdc-4856-4053-bb2c-556f01067b9b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.163981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85222853-6d88-4631-b420-c5dd98a7b8be None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.201953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.202597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.202879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.203157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.211675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.214525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-01ed2217-0247-4850-854c-18f5151f12e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:16.220442 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:16.221267 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:16.222030 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 33/61] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:16.223393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10012c64-95a3-4ac0-b7fe-c9b12ee26052 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.223591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10012c64-95a3-4ac0-b7fe-c9b12ee26052 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.223894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10012c64-95a3-4ac0-b7fe-c9b12ee26052 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.230399 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 34/62] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:16.230399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10012c64-95a3-4ac0-b7fe-c9b12ee26052 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.241998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.242639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.242921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.243373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.255177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:16.256938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:16.261928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:16.262770 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:16.263535 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 29/63] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:16.264184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.348433 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10012c64-95a3-4ac0-b7fe-c9b12ee26052 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.378810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f7fa-6aed-4608-9630-d99c9435b37a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.385781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.386412 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.386934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.386934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.397422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-64601263-5afc-4781-b6ba-dc2e3a05ae62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:16.403172 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:16.404074 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:16.404830 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 35/64] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:16.405475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.406630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.406630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.421803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.422804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.423288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.423760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.424469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:16.424939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:16.425454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.425678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:16.427367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.439831 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 30/65] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.440703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.480691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.496240 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 36/66] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:16.497099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.515509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.551360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c13f-9781-4230-bfee-d8a04fbe1fd3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.587929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.589324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.589751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.590172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.591003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:16.591515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.593182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.601205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971361e3-e1d5-4e77-bb12-a71fa39892b8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.602408 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 31/67] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.603593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.645720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.646823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.647411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.647842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.649385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:16.649841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.652034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d390dc-38ff-42ce-93e8-8e6867d9940a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.668015 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 37/68] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.668015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ddcf-1451-40fa-84f8-eb68f2e41bf3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.668015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ddcf-1451-40fa-84f8-eb68f2e41bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.668015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ddcf-1451-40fa-84f8-eb68f2e41bf3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.668015 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 38/69] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:16.672275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ddcf-1451-40fa-84f8-eb68f2e41bf3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.717991 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.722029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec10bc-e6af-4f09-a2dc-b468a3537277 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.755672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.758517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.759170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.759476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.759729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.776377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.777847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.779500 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 32/70] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.780275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.780623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ddcf-1451-40fa-84f8-eb68f2e41bf3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.815475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.816125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.816405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.816672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] PATH_INFO: `/v3/users/ce8ca093fadc4e9da3bc39e824be9781` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.817785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] RBAC: Authorizing `identity:get_user(user_id=ce8ca093fadc4e9da3bc39e824be9781)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.819216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6a5d3-019c-4863-b2b9-4c52d4114cff None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.820807 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 39/71] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/users/ce8ca093fadc4e9da3bc39e824be9781 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.821975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.822257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.822579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.840511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:16.841706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:16.880975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1fd4-906e-4d02-b1bb-9bbce7dd7127 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:16.909742 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 40/72] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:16.910389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.918076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:16.919122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:16.919409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:16.919685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:16.921223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:16.923106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:16.925026 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 33/73] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:16.925715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:16.951838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:16.996817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.023732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7d71-0d49-4e43-8dce-5b5874cdd87a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.032716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba32a1-0c62-422e-9725-6ea207e44cad None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.061617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.062394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.062681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.062948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.073232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249892-0532-4080-a025-cb56a020794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.073861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249892-0532-4080-a025-cb56a020794c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.074141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249892-0532-4080-a025-cb56a020794c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.074238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:17.074422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249892-0532-4080-a025-cb56a020794c None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.075560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da249892-0532-4080-a025-cb56a020794c None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.077033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da249892-0532-4080-a025-cb56a020794c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.078839 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 34/74] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.079409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249892-0532-4080-a025-cb56a020794c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:17.080248 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:17.081110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:17.081880 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 41/75] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:17.082499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.185001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.192005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5dc4-bf85-4117-9973-466a6278570e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.193878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249892-0532-4080-a025-cb56a020794c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.225637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.226250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.226528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.226796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.227830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.227955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.228470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.229459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.229767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.229966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.230960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.231576 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 42/76] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.236507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.236616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.237999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.238894 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 35/77] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.239551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.335257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ba4b-cdde-4337-8d19-ed7a431ab0f9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.337799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b72f-1bbd-46f4-9055-9cc8df950d01 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.369326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.370074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.370354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.370623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.371274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:17.371574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.372171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.372824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.372979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.373105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.373379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/d668b39e40ef454bba240eec588f5442/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.375323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, user_id=d668b39e40ef454bba240eec588f5442, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.376790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.380883 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 43/78] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.382209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.392705 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 36/79] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:17 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/d668b39e40ef454bba240eec588f5442/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:17.396718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.422811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.458743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.498073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad27ed-e207-4ef4-9302-2a72554e7979 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.521459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4675b-c863-40d6-b7cf-2e8eed29dc94 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.535058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.535711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.536031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.536307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.537554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.539086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.540762 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 44/80] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.542107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.566322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.566995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.567278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.567554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/d668b39e40ef454bba240eec588f5442/roles/42aa243014164140995772918b521a86` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.571072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, user_id=d668b39e40ef454bba240eec588f5442, role_id=42aa243014164140995772918b521a86)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.572178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.587248 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 37/81] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:17 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/d668b39e40ef454bba240eec588f5442/roles/42aa243014164140995772918b521a86 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:17.588829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.688392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439faf-5f0b-4ab4-8db6-bd4bd1cbbc47 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.696086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.725984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192dab-d7d0-4ca5-9dca-610fc030ec32 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.730692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.731323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.731670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.732041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/ce8ca093fadc4e9da3bc39e824be9781/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.734339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, user_id=ce8ca093fadc4e9da3bc39e824be9781, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.736024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.738624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:17.758006 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 45/82] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:17 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/ce8ca093fadc4e9da3bc39e824be9781/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:17.763950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.781229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.781931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.782219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.782500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.783711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.785357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.787111 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 38/83] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.793046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:17.916610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6de8c-d790-4b56-b77e-576d1a82a091 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.940510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332200e-8fbe-448c-86c3-1e59c05ebb2c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:17.964485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.965432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.965916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.966375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.967755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.970270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b722-ec23-4c6d-895c-82c2a9fc5499 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.984263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:17.984914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:17.985196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:17.985508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] PATH_INFO: `/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:17.987281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] RBAC: Authorizing `identity:get_project(project_id=4e70794e8a5b4a6fa48cc42b0c79824b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:17.988856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:17.990835 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 39/84] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:17 2022] GET /identity/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:17.997240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:18.004793 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 46/85] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:17 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:18.021551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:18.134521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983420-7fa3-4a50-b17e-921f077299af None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:18.176011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:18.177025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:18.177489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:18.177934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] PATH_INFO: `/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b/users/d668b39e40ef454bba240eec588f5442/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:18.180170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e70794e8a5b4a6fa48cc42b0c79824b, user_id=d668b39e40ef454bba240eec588f5442, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:18.182446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387848-16b5-4d35-83c1-f7f2e4cbc38a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:18.206005 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:17 2022] PUT /identity/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b/users/d668b39e40ef454bba240eec588f5442/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:19.835517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeae96-7fb3-47ed-94f8-0566dcdc0178 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:19.836040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeae96-7fb3-47ed-94f8-0566dcdc0178 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:19.836147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeae96-7fb3-47ed-94f8-0566dcdc0178 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:19.837452 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 47/87] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:19.843327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543e06-7b94-4f84-abb3-98d7f1a725c4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:19.843719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543e06-7b94-4f84-abb3-98d7f1a725c4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:19.843931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543e06-7b94-4f84-abb3-98d7f1a725c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:19.868849 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-08543e06-7b94-4f84-abb3-98d7f1a725c4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:19.870004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-08543e06-7b94-4f84-abb3-98d7f1a725c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:19.962438 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 41/88] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:20.498740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeae96-7fb3-47ed-94f8-0566dcdc0178 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:20.541745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc15e6-31af-4263-90bc-8ee6ef2ecfb0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:20.542373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc15e6-31af-4263-90bc-8ee6ef2ecfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:20.542880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc15e6-31af-4263-90bc-8ee6ef2ecfb0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:20.544498 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 42/89] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:20.550165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:20.550707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:20.551182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:20.564724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:20.570841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:20.571490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:20.574497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:20.693598 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 43/90] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:20.716597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeae96-7fb3-47ed-94f8-0566dcdc0178 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:20.763449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:20.764029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:20.764315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:20.764593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:20.775564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:20.780931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:20.781793 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:20.782575 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 48/91] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:20.787879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.017059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ad45-3296-4f09-b805-15e66cede832 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.055362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.056438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.057442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.057921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.058922 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:21.059442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:21.061113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:21.066912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.079439 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 44/92] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:21.089136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.198144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.235771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2454-e7d3-4c6f-9ae6-968bd55a4a2b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.256149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.289832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.290470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.290751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.291650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.293123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:21.294602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3fd2d-cf87-431a-bdfe-0f6be77c03ce None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:21.296226 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 49/93] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:21.297355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef939b-60aa-40f4-91db-139df873b41e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.297644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef939b-60aa-40f4-91db-139df873b41e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.297921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef939b-60aa-40f4-91db-139df873b41e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.299133 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 50/94] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:21.300179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45da9-993f-4104-803c-7d18f9b1a244 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.303948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45da9-993f-4104-803c-7d18f9b1a244 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.303948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45da9-993f-4104-803c-7d18f9b1a244 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.303948 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 51/95] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:21.303948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a45da9-993f-4104-803c-7d18f9b1a244 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.349077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab6c95-49c0-4638-81c5-96b1856c4414 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.394985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.395883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.396310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.396728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.408800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5651cec0-a2cc-40c2-8b6f-8149ede03bcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:21.415351 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:21.416736 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:21.417534 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:21.420668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 45/96] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:21.422244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a30-6b56-4105-9e20-df92222ae30d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.422827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a30-6b56-4105-9e20-df92222ae30d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.423327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a30-6b56-4105-9e20-df92222ae30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.423639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a45da9-993f-4104-803c-7d18f9b1a244 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.450229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f5146a30-6b56-4105-9e20-df92222ae30d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:21.452566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f5146a30-6b56-4105-9e20-df92222ae30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:21.466160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.467038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.467510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.467964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.518541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.518833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.536665 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 46/97] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:21.537692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d059-3282-448a-9856-870f5e73f612 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.537978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d059-3282-448a-9856-870f5e73f612 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.538252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d059-3282-448a-9856-870f5e73f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.551932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:21.553932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27782572-07ac-480b-8cee-9a7d4ca06bbd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:21.557811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7865d059-3282-448a-9856-870f5e73f612 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:21.558274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7865d059-3282-448a-9856-870f5e73f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:21.643282 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 47/98] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:21.644408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d059-3282-448a-9856-870f5e73f612 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.669734 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:21.671019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac4b-ae49-41da-ab28-b96624e12fa4 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.671311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac4b-ae49-41da-ab28-b96624e12fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.671587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac4b-ae49-41da-ab28-b96624e12fa4 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.672881 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 53/100] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:21.684926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbac4b-ae49-41da-ab28-b96624e12fa4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.830955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.832004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d059-3282-448a-9856-870f5e73f612 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.852654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:21.862498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbac4b-ae49-41da-ab28-b96624e12fa4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:21.876967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.878047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.878610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.879071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.879984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:21.880477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:21.882346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3426cd-1b69-4802-b9df-5d58a9b9dcfe None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:21.892456 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 48/101] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:21.893962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.894441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.894903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.905618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:21.906258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:21.906540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:21.906812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:21.907957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:21.909706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:21.911193 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 54/102] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:21.916711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:21.917166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:21.918653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:21.998996 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 49/103] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:22.000784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.033747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0f0e4-b48a-4a6a-9156-5f3ab39ee962 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.071333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.071981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.072812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.073077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.085894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:22.091482 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:22.096237 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 55/104] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:22.097319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.104649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.125371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95af28f-5811-4c18-a8af-26c656e7f683 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.137687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.164453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.165136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.165446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.166071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.166978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.168865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.175025 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 50/105] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:21 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:22.175025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.200033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e727-1ebc-446e-a1fb-0145105f088e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.233160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.233862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.234211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.234551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.235340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] RBAC: Adding query filter params (role.id=2c9e8a9da54c45a0b7b872570a089d91, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68, user.id=d668b39e40ef454bba240eec588f5442) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:22.235699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.237244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ca9f4-dd40-433b-a392-96c9c19a4a9e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 56/106] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/role_assignments?user.id=d668b39e40ef454bba240eec588f5442&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60aa5-62f6-4d07-9f33-62c70fba0cbf None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60aa5-62f6-4d07-9f33-62c70fba0cbf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60aa5-62f6-4d07-9f33-62c70fba0cbf None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 57/107] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:22.248027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60aa5-62f6-4d07-9f33-62c70fba0cbf None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.303609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346353ca-e947-4785-ae0e-60f2690b7e7f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.329609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.349071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.350056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.350461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.350839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.366228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:22.370448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60aa5-62f6-4d07-9f33-62c70fba0cbf None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:22.372053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:22.373083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:22.373898 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 51/108] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:22.374508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.418859 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.419478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.419763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.420070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.420753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:22.421060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.421566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.423019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ad71-a4c9-4062-91af-a0c36e83c696 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.434126 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 58/109] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:22.435307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.435599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.435996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.457868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:22.459553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:22.503110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed829-c895-4965-83e8-88013b85d959 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.534216 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 59/110] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:22.535069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.536935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.537541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.537829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.538106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.600366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.615592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.617205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.646397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b731ef5-3d68-44f5-987b-2a62bf969b85 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.659157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.685104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.685735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.686022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.686300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.696314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:22.701446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:22.702498 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:22.703469 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 60/111] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:22.708022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.732662 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 52/112] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:22.738250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.812453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1be1-19c5-44d4-88cf-20047ba72e68 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.834745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.846055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68608e-81e1-4bc9-9737-9955a8972628 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.847159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.847770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.848081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.848355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.849019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:22.849323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.851037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.859073 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 61/113] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:22.860688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.884597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.886038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.886325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.886682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] PATH_INFO: `/v3/users/15eee0c817a643f591601b4d0a562855` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:22.894933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:22.902272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] RBAC: Authorizing `identity:get_user(user_id=15eee0c817a643f591601b4d0a562855)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:22.903774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:22.905451 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 53/114] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/users/15eee0c817a643f591601b4d0a562855 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:22.906260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:22.965903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adbbd-d6da-4fe3-a36b-5b0661d4935f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:22.998463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:22.999075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:22.999359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:22.999642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.000335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:23.000639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.002014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.004291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30750-0ec3-4f97-b989-738ee8ca2241 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.010289 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 62/115] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.011072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.042253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.042873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.043150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.043420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.044534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.046008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.047613 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 54/116] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:22 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.048401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.064943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.108937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.120624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24f0a-1e97-48ea-b4bf-ba91082f0652 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.147110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f334e-0b0f-4441-bf30-198623c58fd7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.154097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.154720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.154999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.155267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.156403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.157836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.159384 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 63/117] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.160170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.186156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.186782 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.187058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.187330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] PATH_INFO: `/v3/users/ce8ca093fadc4e9da3bc39e824be9781` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.188467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce8ca093fadc4e9da3bc39e824be9781)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.189896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.191619 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 55/118] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/users/ce8ca093fadc4e9da3bc39e824be9781 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.192209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.266132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f284d-fc71-440b-beb1-8b9317091c60 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.279781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.290029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8921-447a-479a-a114-8fce7b88f7c3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.300997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.301624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.301905 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.302186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.303311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.304812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.306436 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 64/119] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.307715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.324830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.330420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.331042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.331487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.331764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] PATH_INFO: `/v3/users/d668b39e40ef454bba240eec588f5442` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.333246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] RBAC: Authorizing `identity:get_user(user_id=d668b39e40ef454bba240eec588f5442)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.334687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.336293 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 56/120] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/users/d668b39e40ef454bba240eec588f5442 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.337114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.406770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713e44-0408-4a42-b3fb-233bf82d808e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.436021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8e30-50fc-4910-ad6e-6ce4d4bd05d3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.439866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.440496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.440780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.441055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.441786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] RBAC: Adding query filter params (role.id=42aa243014164140995772918b521a86, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68, user.id=d668b39e40ef454bba240eec588f5442) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:23.442095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.443549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.449991 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 65/121] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/role_assignments?user.id=d668b39e40ef454bba240eec588f5442&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=42aa243014164140995772918b521a86 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:23.450785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.484628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.485362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.485641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.485921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.487951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.490813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.503119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.522924 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 57/122] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:26:23 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:23.524078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.571929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4246-87eb-4960-b803-5ee190a8aa90 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.601907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.614600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.615387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.615770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.616166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.683162 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da678b-34e9-4077-9b7f-ea347c921d7c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.711666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.715814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.733637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.734327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.734612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.734915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/15eee0c817a643f591601b4d0a562855/roles/9fc404ad6efe4526be590d5a1847fbef` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.736999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, user_id=15eee0c817a643f591601b4d0a562855, role_id=9fc404ad6efe4526be590d5a1847fbef)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:23.738460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:23.753731 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 58/123] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:23 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/users/15eee0c817a643f591601b4d0a562855/roles/9fc404ad6efe4526be590d5a1847fbef => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:23.754334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.772386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.844574 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 66/124] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:23.850382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:23.894981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ec5e-2588-4257-845f-dda8a446f2ae None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:23.913256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:23.938259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:23.938795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:23.939079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:23.939351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:23.974490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265fcb-7512-47ea-818b-7aa5fdd24a20 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:24.020710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:24.021329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:24.021446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:24.021664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:24.021946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:24.022808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:24.023081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:24.024673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:24.027259 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 67/125] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:24.033088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:24.049971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:24.153879 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 59/126] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:24.155424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063f0a4-7898-46ac-9080-adebd9adcc3d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:24.160208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:24.178978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:24.200763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:24.201681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:24.202195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:24.202718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:24.203719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68, user.id=ce8ca093fadc4e9da3bc39e824be9781) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:24.204246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:24.205883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:24.212087 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 68/127] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:24 2022] GET /identity/v3/role_assignments?user.id=ce8ca093fadc4e9da3bc39e824be9781&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:24.284194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ad7-cf79-49fb-9ea8-a282a5848b28 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:24.325054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:24.325701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:24.325986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:24.326253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] PATH_INFO: `/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:24.327433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] RBAC: Authorizing `identity:get_project(project_id=4e70794e8a5b4a6fa48cc42b0c79824b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:24.328940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740b54-74e5-46dd-be79-58eb365ec192 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:24.330967 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 60/128] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:24 2022] GET /identity/v3/projects/4e70794e8a5b4a6fa48cc42b0c79824b => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:24.337010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:24.440681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:24.465142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d08c5-7b72-44a2-9857-da3adbad6921 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:24.499957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:24.500571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:24.500854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:24.501129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:24.501857 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] RBAC: Adding query filter params (role.id=2c9e8a9da54c45a0b7b872570a089d91, scope.project.id=4e70794e8a5b4a6fa48cc42b0c79824b, user.id=d668b39e40ef454bba240eec588f5442) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:24.502165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:24.503603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72d23-03b5-4318-913a-21aaecb3d18b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:24.515884 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 69/129] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:24 2022] GET /identity/v3/role_assignments?user.id=d668b39e40ef454bba240eec588f5442&scope.project.id=4e70794e8a5b4a6fa48cc42b0c79824b&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:25.822762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f94c1-db90-499a-aaae-22e575dd8661 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:25.823302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f94c1-db90-499a-aaae-22e575dd8661 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:25.823302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f94c1-db90-499a-aaae-22e575dd8661 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:25.824760 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 61/130] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:25.830062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118813-5d30-4edd-b2c6-acdaaf84a099 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:25.830472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118813-5d30-4edd-b2c6-acdaaf84a099 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:25.830611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118813-5d30-4edd-b2c6-acdaaf84a099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:25.848577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-59118813-5d30-4edd-b2c6-acdaaf84a099 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:25.850004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-59118813-5d30-4edd-b2c6-acdaaf84a099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:25.919934 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 70/131] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:26.000464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c82-91ba-4d2b-9e20-dfbfbec56037 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.000753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c82-91ba-4d2b-9e20-dfbfbec56037 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.001027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c82-91ba-4d2b-9e20-dfbfbec56037 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.002363 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 62/132] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:26.007709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.008040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.008322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.027317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:26.028519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:26.093063 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 71/133] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:26.199054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e994c82-91ba-4d2b-9e20-dfbfbec56037 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.280521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:26.300907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e994c82-91ba-4d2b-9e20-dfbfbec56037 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.334139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.334756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.335037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.335307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.336426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:26.338377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:26.340061 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 63/134] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:26.345694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.348325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:26.362362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.446149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3252c-ab8f-4de0-af46-ed442a953da9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.459740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc448328-bea1-43b1-80ac-0ca8cfc85070 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.480668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.481276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.481558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.481835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.482501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:26.483973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:26.493585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.494469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.494843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.495165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.504874 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 72/135] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:26 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:26.513336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:26.514243 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:26.515127 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 64/136] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:26.519025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.583067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:26.631968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930ddb-4ca4-468c-a2f3-ec32df7255bf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.668355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.668961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.669231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.669497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.670164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:26.670459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:26.671833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:26.680439 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 73/137] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:26.687928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.699393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:26.792123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559717b-3987-49ba-a326-d2a92786f563 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.830046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.830663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.830958 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.831239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] PATH_INFO: `/v3/users/15eee0c817a643f591601b4d0a562855` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:26.832416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] RBAC: Authorizing `identity:get_user(user_id=15eee0c817a643f591601b4d0a562855)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:26.833890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:26.835676 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 65/138] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:26 2022] GET /identity/v3/users/15eee0c817a643f591601b4d0a562855 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:26.841241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:26.954204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16464-e846-4b0c-9f34-8bdfbe389b32 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:26.975752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:26.992054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:26.992672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:26.992956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:26.993261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:27.064594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:27.065982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:27.172898 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 74/139] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:27.178207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:27.260068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:27.285123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec7a2-e9b6-4493-97f0-776cb2b5d033 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:27.325339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:27.325897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:27.326236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:27.326724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:27.327885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:27.329347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f2b2-e80b-48f4-8099-156960c53d4a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:27.330984 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 66/140] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:27 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:27.337088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:27.361249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:27.443693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931884-5950-4868-abca-3e1289c925e8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:27.479703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:27.480356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:27.480622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:27.480892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:27.481639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] RBAC: Adding query filter params (role.id=9fc404ad6efe4526be590d5a1847fbef, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68, user.id=15eee0c817a643f591601b4d0a562855) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:27.481930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:27.483385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbd1d-4db6-47ff-9117-8bd6f5fa9d53 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:27.489532 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 75/141] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:27 2022] GET /identity/v3/role_assignments?user.id=15eee0c817a643f591601b4d0a562855&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=9fc404ad6efe4526be590d5a1847fbef => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:28.797552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20fcaf-22a7-44e4-b47f-52ea444579be None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.798077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20fcaf-22a7-44e4-b47f-52ea444579be None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.798339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20fcaf-22a7-44e4-b47f-52ea444579be None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.799645 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 67/142] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:28.804729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a742b6-16d9-465f-aeff-0c7d727524f5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.805124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a742b6-16d9-465f-aeff-0c7d727524f5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.805302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a742b6-16d9-465f-aeff-0c7d727524f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.824254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-51a742b6-16d9-465f-aeff-0c7d727524f5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:28.825426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-51a742b6-16d9-465f-aeff-0c7d727524f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:28.900874 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 76/143] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:28.961579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9600-64cd-4349-a8b2-f5837f9ccf03 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.961892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9600-64cd-4349-a8b2-f5837f9ccf03 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.962144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9600-64cd-4349-a8b2-f5837f9ccf03 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.964382 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 68/144] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:28.970333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a64c-2e71-4755-9188-27ca71287757 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.970629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a64c-2e71-4755-9188-27ca71287757 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.970887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281a64c-2e71-4755-9188-27ca71287757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.989299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5281a64c-2e71-4755-9188-27ca71287757 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:28.990473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5281a64c-2e71-4755-9188-27ca71287757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:28.999760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.058833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2e8a-460f-4328-88ce-711930f83979 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.059147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2e8a-460f-4328-88ce-711930f83979 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.059393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2e8a-460f-4328-88ce-711930f83979 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.060074 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 77/145] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:29.060878 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 69/146] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:29.065792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.066085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.066359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.084562 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:29.085734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:29.154302 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 78/147] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:29.176989 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc2e8a-460f-4328-88ce-711930f83979 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.279947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc2e8a-460f-4328-88ce-711930f83979 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.312937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.313553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.313836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.314093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.324586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:29.328661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:29.329470 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:29.330295 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:29.331274 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 70/148] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:29.337710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.341824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.405539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.430648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87de4-90a0-400a-967e-560438dc3d9c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.445739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a729-d09d-444e-be0c-b82540b3fcf7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.464774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.465395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.465668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.465933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.475954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:29.481347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:29.481647 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:29.482730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:29.483705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:29.484808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.484808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.484808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.484984 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 79/149] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:29.485062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:29.485062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.485187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.485311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.497734 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 71/150] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:29.497734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.559367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.589417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf582a-4af1-480d-9c59-20632b07acd5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.600688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29b9cf-0a44-46af-bb96-a8720c1fdbdf None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.626353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.626973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.627247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.627513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.628643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.630087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.631637 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 80/151] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.635981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.638152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.640267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.640906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.641156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.641428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.642087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:29.642390 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.643785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.651955 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 72/152] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.656890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.734608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d5153-53c7-4395-b845-69ab8557957c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.754925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4538064-4fa0-4b2a-8db2-9b07f2558c62 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.769543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.770160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.770424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.770694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] PATH_INFO: `/v3/users/6f12c41cb4094337acc3d622589dbdbf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.780791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.784233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] RBAC: Authorizing `identity:get_user(user_id=6f12c41cb4094337acc3d622589dbdbf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.785736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.787360 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 81/153] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/users/6f12c41cb4094337acc3d622589dbdbf => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.788246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.789475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.790069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.790343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.790610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.791876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.793422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.821186 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 73/154] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:29 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:29.828941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.855920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.903023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86e8f-9e5a-4aa4-8add-d5ad74ed29ac None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.939719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.940315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.940594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.940866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] PATH_INFO: `/v3/users/6f12c41cb4094337acc3d622589dbdbf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.942042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] RBAC: Authorizing `identity:get_user(user_id=6f12c41cb4094337acc3d622589dbdbf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.943519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.944152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5a60-ad75-471c-b921-f45d0b021cfb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.945358 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 82/155] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/users/6f12c41cb4094337acc3d622589dbdbf => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.951045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.986041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.986679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.987023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.987294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.988460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.990534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.992382 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 74/156] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.998591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:30.059055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:30.066955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914cc77-a9ae-4949-acf0-b525e8f84d39 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:30.104343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:30.114209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:30.114927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:30.115273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:30.115570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:30.116861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:30.117777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147c07-ca65-4bb7-9ddd-14faf5c4d4c1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:30.118329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:30.121366 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 83/157] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:30.126901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:30.165807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:30.166681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:30.166976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:30.167325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6f12c41cb4094337acc3d622589dbdbf/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:30.169385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, user_id=6f12c41cb4094337acc3d622589dbdbf, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:30.170850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff342-88e1-4e88-89c1-5ebb9e760df8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:30.186965 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 75/158] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:29 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6f12c41cb4094337acc3d622589dbdbf/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:30.262991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a648-ceed-4ddf-90ac-3aa90f637490 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:30.304341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:30.305017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:30.305292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:30.305562 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6f12c41cb4094337acc3d622589dbdbf/roles/42aa243014164140995772918b521a86` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:30.308653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, user_id=6f12c41cb4094337acc3d622589dbdbf, role_id=42aa243014164140995772918b521a86)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:30.310231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbd75-c482-49d8-b3ce-982866950643 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:30.327946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 84/159] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:30 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6f12c41cb4094337acc3d622589dbdbf/roles/42aa243014164140995772918b521a86 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:32.131814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23633b-8f87-4724-9243-e1c60432c597 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.132379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23633b-8f87-4724-9243-e1c60432c597 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.132654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23633b-8f87-4724-9243-e1c60432c597 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.134133 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 76/160] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:32.139485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc1b0-a8bb-418d-adb2-31321d9354ef None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.139920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc1b0-a8bb-418d-adb2-31321d9354ef None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.140235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc1b0-a8bb-418d-adb2-31321d9354ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.158976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-99afc1b0-a8bb-418d-adb2-31321d9354ef None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:32.160187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-99afc1b0-a8bb-418d-adb2-31321d9354ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:32.207458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f444d-9a3f-4a4f-9b99-358faca1cd56 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.207780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f444d-9a3f-4a4f-9b99-358faca1cd56 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.208021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f444d-9a3f-4a4f-9b99-358faca1cd56 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.209477 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 77/161] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:32.215133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776f370-e304-4ba9-ac00-722c7c69ced0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.215410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776f370-e304-4ba9-ac00-722c7c69ced0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.215675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776f370-e304-4ba9-ac00-722c7c69ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.222214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:32.239572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0776f370-e304-4ba9-ac00-722c7c69ced0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:32.240953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0776f370-e304-4ba9-ac00-722c7c69ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:32.247140 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 85/162] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:32.315523 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 78/163] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:32.500767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b758-e873-4251-a96a-6d696137731c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.501420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b758-e873-4251-a96a-6d696137731c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.501895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b758-e873-4251-a96a-6d696137731c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.503460 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 86/164] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:32.508846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7cc0-7690-4681-9081-5cb05361cf8c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.509405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7cc0-7690-4681-9081-5cb05361cf8c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.509939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7cc0-7690-4681-9081-5cb05361cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.526486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b758-e873-4251-a96a-6d696137731c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.529706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-615d7cc0-7690-4681-9081-5cb05361cf8c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:32.530918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-615d7cc0-7690-4681-9081-5cb05361cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:32.570153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:32.607150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 79/165] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:32.608542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004274-532f-4995-b555-8c68d41c6dd3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.608806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004274-532f-4995-b555-8c68d41c6dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.609073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004274-532f-4995-b555-8c68d41c6dd3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.610484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 80/166] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:32.615066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b004274-532f-4995-b555-8c68d41c6dd3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.641028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b758-e873-4251-a96a-6d696137731c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:32.676476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:32.677095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.677370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.677835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.688537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-de55e7cb-fdce-4ee8-b682-256fc7919fe3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:32.693378 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:32.694256 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:32.695051 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 87/167] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:32.695712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.696544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.696544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.716310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:32.717478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:32.729903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b004274-532f-4995-b555-8c68d41c6dd3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:32.763882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:32.765214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:32.765838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.766114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.766402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.767472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:32.769011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:32.770707 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 81/168] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:32.771362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.799903 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 88/169] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:32.799903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.827348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:32.893359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22494d1-32ca-463d-94f8-3ccce4c9a21b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:32.916771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2590c-6975-451a-8215-dc624b6cd707 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:32.934512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:32.935170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.935450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.935718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.936516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:32.936816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:32.938179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:32.949154 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 82/170] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:32.949792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.954892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:32.955534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.955811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.956122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.956773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:32.958213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:32.981969 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 89/171] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:32.982714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.029136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.095927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd5a4-d7a9-4560-b6a3-1c630ace2b37 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.097790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.125274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebea3-f384-43b6-8fe6-36dcdba506e3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.140170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.140767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.141040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.141306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.153878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:33.159089 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:33.160030 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 83/172] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:33.167484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.175759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.177048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.177491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.177919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] PATH_INFO: `/v3/users/a4d74accbd184122b3c752ca1170639c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.195425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] RBAC: Authorizing `identity:get_user(user_id=a4d74accbd184122b3c752ca1170639c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.198746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.199501 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 90/173] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/users/a4d74accbd184122b3c752ca1170639c => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.203998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.292110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d522-b533-417a-a638-88279b7328fc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.332725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe43-25f0-4c0e-90bd-00f844a2b655 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.335645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.335946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.336323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.336699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.350157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:33.355224 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:33.356414 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 84/174] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:33.357247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.376914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.377547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.377882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.378161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.378844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:33.379175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.381550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.391626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.395410 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 91/175] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.395410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.507239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abf05f-9e6f-4d41-90c8-68cf8d816bba None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.511975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f499a-6ece-4108-ac19-9744fe4b4b0b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.543872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.544450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.544732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.545004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.545674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:33.545976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.547443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.556155 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 92/176] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.557139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.558344 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.559107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.559489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.560146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.561691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.563241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.566020 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 85/177] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.566881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.579474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.685690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.688946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef944-3919-4687-b89b-01a6e3421edd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.696535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb319de8-9b64-4646-acfb-6e98bf682103 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.734964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.735679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.735949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.736323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.736700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] PATH_INFO: `/v3/users/6f12c41cb4094337acc3d622589dbdbf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.737006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.737421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.737831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] PATH_INFO: `/v3/users/6f12c41cb4094337acc3d622589dbdbf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.738259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] RBAC: Authorizing `identity:get_user(user_id=6f12c41cb4094337acc3d622589dbdbf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.739283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] RBAC: Authorizing `identity:get_user(user_id=6f12c41cb4094337acc3d622589dbdbf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.739967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.741048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.741746 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 86/178] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/users/6f12c41cb4094337acc3d622589dbdbf => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.742620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.743122 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 93/179] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/users/6f12c41cb4094337acc3d622589dbdbf => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.748785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.856412 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.860390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0ca4-df4f-4ad9-9625-3bfc6705de56 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.867166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2bb5-6bab-4af7-8d10-2a3bf5459950 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.898586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.899579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.900303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.900990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.910919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.911584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.911883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.912164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/a4d74accbd184122b3c752ca1170639c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.915062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, user_id=a4d74accbd184122b3c752ca1170639c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.917184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.939887 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 87/180] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:33 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/a4d74accbd184122b3c752ca1170639c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:33.939887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.961420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.038093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.040036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.069457 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157563-cb65-4e84-a19b-6bc12b045271 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.113494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.114056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.114336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.114607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.198230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.199728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.221690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.228741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.279107 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 94/181] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:34.288804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.320584 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 88/182] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:34.326947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.403656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10d1d-1f81-4141-b863-8f6f16f956e0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.452070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c9be-3838-4386-beb1-cd19a87f39c3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.465390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.466022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.466294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.466561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.467695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.469175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.471105 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 95/183] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:34.481577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.498272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.531609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.532270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.532662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.532936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.534299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.535755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.537639 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 89/184] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:34.544500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.563211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.653221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464817bf-3a6d-4196-89c6-59e8c686e5a5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.674937 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa21b8-6f00-4609-aee8-a77f261a708f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.693589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.694199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.694473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.694747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.695473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=0280a594f52b465ab158ea7030fd3e42, user.id=6f12c41cb4094337acc3d622589dbdbf) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:34.695778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.697516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7a6d-e47c-4cef-afed-05c2240048d0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.715407 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 90/185] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/role_assignments?user.id=6f12c41cb4094337acc3d622589dbdbf&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:34.738015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.738627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.738903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.739172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.739926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] RBAC: Adding query filter params (role.id=42aa243014164140995772918b521a86, scope.project.id=0280a594f52b465ab158ea7030fd3e42, user.id=6f12c41cb4094337acc3d622589dbdbf) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:34.740233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.741680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc68c2e-cae4-45da-9355-4bb1f13ecc7f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.753173 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 96/186] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/role_assignments?user.id=6f12c41cb4094337acc3d622589dbdbf&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=42aa243014164140995772918b521a86 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:35.414116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f13c-82f8-46db-bcea-f1cae3f4a894 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:35.414659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f13c-82f8-46db-bcea-f1cae3f4a894 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:35.414882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f13c-82f8-46db-bcea-f1cae3f4a894 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:35.416457 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 91/187] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:35.421429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1c3d8-c675-446d-9792-92f1149bd9e9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:35.421813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1c3d8-c675-446d-9792-92f1149bd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:35.421989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1c3d8-c675-446d-9792-92f1149bd9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:35.440838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bde1c3d8-c675-446d-9792-92f1149bd9e9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:35.442019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bde1c3d8-c675-446d-9792-92f1149bd9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:35.514959 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 97/188] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:35.674139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b744-c285-4b25-99ef-2064b03d0d2d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:35.674389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b744-c285-4b25-99ef-2064b03d0d2d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:35.674613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b744-c285-4b25-99ef-2064b03d0d2d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:35.676001 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 92/189] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:35.681349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:35.681702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:35.681984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:35.701211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:35.702397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:35.743187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:35.770837 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 98/190] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:35.789619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b744-c285-4b25-99ef-2064b03d0d2d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:35.842857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:35.896394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b744-c285-4b25-99ef-2064b03d0d2d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:35.932085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:35.932636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:35.932916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:35.933186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:35.943517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:35.948480 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:35.949373 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:35.950184 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 93/191] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:35.956685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.040282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.060018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72596fd2-732a-480b-b086-1537f0c17306 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.094713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.095322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.095601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.096317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.096987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:36.097293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.098677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.107826 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 99/192] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:36.113009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.146323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb027f-f50a-4705-b11e-7a5d3d2dc585 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.149577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:36.158295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:36.184486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.185217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.185496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.185768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.187748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.189226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.191006 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 94/193] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:36.196108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.223183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811374fb-1d27-4b76-91ee-92d19b6ea106 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.266829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.267976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.268400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.269344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] PATH_INFO: `/v3/users/6b2d858bc32747c099bc125d0e352708` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.287196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] RBAC: Authorizing `identity:get_user(user_id=6b2d858bc32747c099bc125d0e352708)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.288871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.291191 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 100/194] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:36 2022] GET /identity/v3/users/6b2d858bc32747c099bc125d0e352708 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:36.296833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.311796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba014-eb65-4bec-93b4-26193da3b2f8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.355038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.355635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.355941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.356211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.356850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.358290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085ae0-f396-4f6d-aec8-9fcddbcbb16e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.383550 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 95/195] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:36 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:26:36.406270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:36.409121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711928a8-aa31-4b64-a342-24b58b5e2de5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.409396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711928a8-aa31-4b64-a342-24b58b5e2de5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.409670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711928a8-aa31-4b64-a342-24b58b5e2de5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.411389 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 96/196] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:36.416545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd129d-d091-4ffa-8421-4de9c5983285 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.421400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.421926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.421926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.442609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:36.443742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:36.457671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.458329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.458609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.458885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.460214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.461713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.463871 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 101/197] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:36 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:36.469514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.479893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:36.532381 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 97/198] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:36.590204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea0b6-f9a8-4d28-b3a3-3c2dd8c5adde None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.626253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.626904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.627178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.627724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6b2d858bc32747c099bc125d0e352708/roles/9fc404ad6efe4526be590d5a1847fbef` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.629693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, user_id=6b2d858bc32747c099bc125d0e352708, role_id=9fc404ad6efe4526be590d5a1847fbef)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:36.631139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:36.647293 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 102/199] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:36 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/users/6b2d858bc32747c099bc125d0e352708/roles/9fc404ad6efe4526be590d5a1847fbef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:36.813846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:36.921799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0243a4-917a-4e4e-b1fc-5f1232d7ddab None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:36.957741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:36.958378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:36.958658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:36.958929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:36.970479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:36.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:36.976715 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:36.977499 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 98/200] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:36.985069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.016321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.094235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54cc3-2135-4620-a4fa-ee16d2a54d36 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.131109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.131728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.132033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.132307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.132974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:37.133274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:37.135409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:37.147984 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 103/201] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:37.150595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.177795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.261082 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27003f1f-8bd5-4b85-913a-1a565bfda937 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.297145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.297774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.298051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.298312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] PATH_INFO: `/v3/users/a4d74accbd184122b3c752ca1170639c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.299451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=a4d74accbd184122b3c752ca1170639c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:37.300945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:37.302837 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 99/202] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/users/a4d74accbd184122b3c752ca1170639c => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:37.308426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.398830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.415365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ba23-ba0e-41f9-8f10-73a24f05d943 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.453002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.453638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.453919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.454194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.528998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:37.530479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:37.632251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.639957 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 104/203] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:37.641871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.737373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.748637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2141-7e17-4eea-a1fb-b8764cbd8ca6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.787403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.788049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.789989 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.791056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.795886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:37.795886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abed2e-a812-49de-b4bf-fc6b95fb1a64 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:37.797693 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 100/204] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:37.805790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.919902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1bd7-cd74-42f2-acbc-5e47af934a28 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.948866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.949475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.949761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.950036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.950770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] RBAC: Adding query filter params (role.id=2c9e8a9da54c45a0b7b872570a089d91, scope.project.id=0280a594f52b465ab158ea7030fd3e42, user.id=a4d74accbd184122b3c752ca1170639c) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:37.951076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:37.952561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e78e14-6e21-4392-931d-bccdbe90192c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:37.958853 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 105/205] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/role_assignments?user.id=a4d74accbd184122b3c752ca1170639c&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:38.871172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052428ef-9721-4bab-9294-47a9c76b0217 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.871679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052428ef-9721-4bab-9294-47a9c76b0217 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.871679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052428ef-9721-4bab-9294-47a9c76b0217 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.873260 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 101/206] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:38.879358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062200a-04ab-42ae-abf9-5ccac2a1291c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.879913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062200a-04ab-42ae-abf9-5ccac2a1291c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.879991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062200a-04ab-42ae-abf9-5ccac2a1291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.880210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75c47-e261-41a4-8424-a99f20e06011 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.880460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75c47-e261-41a4-8424-a99f20e06011 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.880735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75c47-e261-41a4-8424-a99f20e06011 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.882138 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 102/207] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:38.888554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9e00-6b28-413a-9774-c5aaedd04b62 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.888940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9e00-6b28-413a-9774-c5aaedd04b62 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.889128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9e00-6b28-413a-9774-c5aaedd04b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.901212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c062200a-04ab-42ae-abf9-5ccac2a1291c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:38.902508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c062200a-04ab-42ae-abf9-5ccac2a1291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:38.908673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f54a9e00-6b28-413a-9774-c5aaedd04b62 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:38.909884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f54a9e00-6b28-413a-9774-c5aaedd04b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:38.951712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:38.979899 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 106/208] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:38.988115 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 103/209] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:38.993292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5447-f9c7-4d53-9832-d05fd80966f3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.994147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5447-f9c7-4d53-9832-d05fd80966f3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.994439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5447-f9c7-4d53-9832-d05fd80966f3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.995776 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 107/210] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:39.001289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.001613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.001889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.021021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:39.022183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:39.089076 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 104/211] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:39.252267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5447-f9c7-4d53-9832-d05fd80966f3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.253880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.277291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.355869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5447-f9c7-4d53-9832-d05fd80966f3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.363664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8c78-18a7-4ab1-9f82-a8cba7dbfd51 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.392426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.393044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.393318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.393584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.397264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.397875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.398153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.398419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.399509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.401604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.403184 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 105/212] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:39.403985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.404414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:39.409545 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:39.410585 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 108/213] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:39.411777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.450179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.496885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.509052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ae41-6c3e-4508-a179-f02d8a311a05 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.509828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b175f1-9ee3-48a3-9242-345c78f41969 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.543482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.543655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.544138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.544238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.544417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.544504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.544689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.544778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.545365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.546809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.554673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:39.560985 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:39.561909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:39.562695 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 106/214] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:39.563367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.567307 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 109/215] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:39 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:39.569025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.681584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e184f-73bb-4f00-9ca7-7ad56d0e0509 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.702635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.712842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09759d7-f941-44fe-9c50-d289ed915da2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.721845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.722343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.722621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.722892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.723567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:39.723896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.725571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.736184 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 107/216] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:39.741595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.752399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.753021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.753300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.753592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.754249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:39.754553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.755231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.755996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.765466 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 110/217] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:39.771610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.863373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1011-aff8-4e0c-9917-abd65302697e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.888433 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290ea4-00dd-497a-a4af-d81efbd29fd1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.910613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.911273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.911540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.913973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] PATH_INFO: `/v3/users/ac3784cf2c2646eb913f9177eef6c401` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.929465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3784cf2c2646eb913f9177eef6c401)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.929855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.931078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.931078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.931241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.931334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] PATH_INFO: `/v3/users/6b2d858bc32747c099bc125d0e352708` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.932233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] RBAC: Authorizing `identity:get_user(user_id=6b2d858bc32747c099bc125d0e352708)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.933092 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 108/218] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/users/ac3784cf2c2646eb913f9177eef6c401 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:39.933832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.935444 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 111/219] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/users/6b2d858bc32747c099bc125d0e352708 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:39.940580 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.941807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.969981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:40.021364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:40.064496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9a968-ea22-438a-960f-39ea7c892822 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:40.074287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf6e0-052a-4f6b-adff-8fc767bed1fb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:40.105922 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:40.106869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:40.107368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:40.107830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:40.108924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] RBAC: Adding query filter params (role.id=2c9e8a9da54c45a0b7b872570a089d91, user.id=ac3784cf2c2646eb913f9177eef6c401, scope.system=all) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:40.109735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:40.111669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:40.117889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:40.118376 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 109/220] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/role_assignments?user.id=ac3784cf2c2646eb913f9177eef6c401&scope.system=all&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:40.118552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:40.118817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:40.119071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:40.199103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:40.200997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:40.229735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:40.317453 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 112/221] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:40.324343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:40.429092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13540bf-8580-4071-85d7-3cbad359399f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:40.465828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:40.472497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:40.473396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:40.473863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:40.474327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:40.476505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:40.478045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633153a5-aac9-4022-a265-54a931f01bac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:40.480033 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 110/222] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:40 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:40.485786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:40.600809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321efe-23ed-45db-9824-11225c916a6c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:40.631494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:40.644152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:40.644780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:40.645054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:40.645322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:40.646079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] RBAC: Adding query filter params (role.id=9fc404ad6efe4526be590d5a1847fbef, scope.project.id=0280a594f52b465ab158ea7030fd3e42, user.id=6b2d858bc32747c099bc125d0e352708) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:40.646383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:40.647925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c6836-5265-43a9-96f8-e9b98f1c97a3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:40.655515 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 113/223] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:40 2022] GET /identity/v3/role_assignments?user.id=6b2d858bc32747c099bc125d0e352708&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=9fc404ad6efe4526be590d5a1847fbef => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:41.934088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb47b3-b6ed-4702-8a19-cdb099493da7 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:41.934570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb47b3-b6ed-4702-8a19-cdb099493da7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:41.934570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb47b3-b6ed-4702-8a19-cdb099493da7 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:41.936099 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 111/224] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:41.941388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:41.941788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:41.941947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:41.945070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4843f-9f66-4d14-8da5-d38a1f942186 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:41.945353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4843f-9f66-4d14-8da5-d38a1f942186 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:41.945619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4843f-9f66-4d14-8da5-d38a1f942186 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:41.947674 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 112/225] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:41.952708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:41.952994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:41.953265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:41.961068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:41.962346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:41.971980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:41.973138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:42.038334 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 114/226] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:42.046521 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 113/227] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:42.306128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.316576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.407760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c449c-0119-47ae-8425-5775b90e4e3a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.419388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc45a1e-f08d-47eb-81de-92a55fce8f80 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.424973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.442670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.443293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.443580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.443827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.444955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:42.446389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46445fc-6a31-42e6-8c95-d5b8f991b28a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:42.448614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.448956 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 115/228] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:42.450065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d473-7426-4c05-a2f6-458f9c8f3c61 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.450341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d473-7426-4c05-a2f6-458f9c8f3c61 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.450609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d473-7426-4c05-a2f6-458f9c8f3c61 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.451863 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 116/229] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:42.454363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d473-7426-4c05-a2f6-458f9c8f3c61 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.461160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.461785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.462059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.462949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.472887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-65ab0c58-5856-430f-854b-0d3770997866 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:42.478054 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:42.479184 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:42.480377 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 114/230] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:42.482503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.482796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.483072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.500380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:42.501563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:42.557677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d473-7426-4c05-a2f6-458f9c8f3c61 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.568941 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 115/231] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:42.569921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.594458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.595060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.595335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.595608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] PATH_INFO: `/v3/groups` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.596558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:42.598134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:42.619898 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 117/232] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Oct 19 00:26:42 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:26:42.698873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dde32-7c9e-4756-82f8-bc4248c9a53f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.721603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.737859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.738497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.738771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.739036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.739706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:42.740036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:42.741428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:42.751560 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 116/233] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:42.757227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.809323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.840589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.870530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47db8-fe63-46fd-aa37-a4087b8c17ce None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.907701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.908442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.908724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.909004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] PATH_INFO: `/v3/users/84cf10c5f6334fd393ca12595cc59181` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.923699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] RBAC: Authorizing `identity:get_user(user_id=84cf10c5f6334fd393ca12595cc59181)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:42.925205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:42.927045 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 118/234] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/users/84cf10c5f6334fd393ca12595cc59181 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:42.933276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.955690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173c29-20e4-47ca-9855-8d67ecd681c8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.993192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.994335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.994623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.994890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.005066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:43.010768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:43.011888 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:43.012826 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 117/235] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:43.018283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.045733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b4f-5b8f-41fc-b11e-621eb222703d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.049242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.065122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.087086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.087974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.088211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.088540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.089526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] RBAC: Adding query filter params (role.id=9fc404ad6efe4526be590d5a1847fbef, user.id=84cf10c5f6334fd393ca12595cc59181, scope.system=all) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:43.089831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.091290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.096495 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 119/236] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/role_assignments?user.id=84cf10c5f6334fd393ca12595cc59181&scope.system=all&role.id=9fc404ad6efe4526be590d5a1847fbef => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:43.132534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd866b1-82cb-46c8-919b-ff0f373a0b64 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.173155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.173767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.174039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.174304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.174972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:43.175266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.176711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.191506 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 118/237] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:43.192573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.303369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30371afc-8476-42aa-ae70-7de607fd0bc0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.337697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.338427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.338806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.339178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] PATH_INFO: `/v3/users/ac3784cf2c2646eb913f9177eef6c401` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.340451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3784cf2c2646eb913f9177eef6c401)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.342004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0ab5-bc99-4fee-ba95-735f0d50a230 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.348513 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 120/238] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/users/ac3784cf2c2646eb913f9177eef6c401 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:43.349510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.452172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e86f6-afdb-4033-946f-416f69f067f3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.454649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.486800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.487581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.487995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.488368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] PATH_INFO: `/v3/system/users/ac3784cf2c2646eb913f9177eef6c401/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.489868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac3784cf2c2646eb913f9177eef6c401, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.491333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6b113-8249-4428-85c6-1301eaadcf47 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.507890 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 119/239] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Oct 19 00:26:43 2022] PUT /identity/v3/system/users/ac3784cf2c2646eb913f9177eef6c401/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:44.833199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f91413-64e0-44fa-9293-d7c9a4037386 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.833705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f91413-64e0-44fa-9293-d7c9a4037386 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.833780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f91413-64e0-44fa-9293-d7c9a4037386 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.835230 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 121/240] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:44.840531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60d22-4e4c-426d-b067-7a24a6c370cb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.840927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60d22-4e4c-426d-b067-7a24a6c370cb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.841086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60d22-4e4c-426d-b067-7a24a6c370cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.859905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-65f60d22-4e4c-426d-b067-7a24a6c370cb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:44.861095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-65f60d22-4e4c-426d-b067-7a24a6c370cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:44.930981 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 120/241] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:45.202772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f91413-64e0-44fa-9293-d7c9a4037386 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:45.242153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:45.262219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09571c9-1132-4fcd-abe0-bdcba8fc352d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.262519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09571c9-1132-4fcd-abe0-bdcba8fc352d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.262773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09571c9-1132-4fcd-abe0-bdcba8fc352d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.264150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 121/242] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:26:45.269197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.269477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.269747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.288522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:45.289725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:45.322848 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f91413-64e0-44fa-9293-d7c9a4037386 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:45.357940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:45.358559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.358980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.359086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.360364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:45.361799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:45.363545 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 122/243] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:45.366448 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 122/244] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:45.372806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:45.474259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86011ca2-7b73-4fc3-bc16-d8fb61881ea0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:45.477176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:45.512161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:45.512757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.513029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.513292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] PATH_INFO: `/v3/groups` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.513910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:45.515346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539109-72b1-4491-9caf-5dd685977b31 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:45.538032 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 123/245] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Oct 19 00:26:45 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:26:45.646532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:45.664613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6b69-921b-4f36-8a82-70a1afc956cf None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.664926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6b69-921b-4f36-8a82-70a1afc956cf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.665179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6b69-921b-4f36-8a82-70a1afc956cf None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.667439 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 124/246] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:45.673116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.673410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.673653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.678744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:45.694893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:45.696170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:45.765860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb78abf-dc7d-432c-b754-02afce67a047 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:45.773357 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 125/247] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:26:45.804235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:45.804864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.805139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.805405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.817576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:45.822568 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:45.823479 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:45.824336 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 123/248] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:45.829488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:45.932154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:45.939540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da1a0d-9cd7-4170-be46-630fdcfef3ae None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:45.980801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:45.981413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:45.981688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:45.981982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:45.982649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:45.982943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:45.984385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:45.993897 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 126/249] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:46.000249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.086965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.097523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:46.111918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83697db-3a48-4bf7-bcb1-e0f0b042d5fd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.154603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.155241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.155517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.155788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] PATH_INFO: `/v3/users/84cf10c5f6334fd393ca12595cc59181` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.157594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] RBAC: Authorizing `identity:get_user(user_id=84cf10c5f6334fd393ca12595cc59181)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:46.159427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:46.161093 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 124/250] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:45 2022] GET /identity/v3/users/84cf10c5f6334fd393ca12595cc59181 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:46.172388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.232464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110e3-cc79-4866-9690-caa0ac62be6c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.279219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.280061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.280340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.280603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.299787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:46.306453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc474-e71b-40b6-9716-1a26e7bb6adc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:46.307513 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:46.308912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:46.309760 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 127/251] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:46.315706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.345085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:46.361257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.361915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.362192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.362465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] PATH_INFO: `/v3/system/users/84cf10c5f6334fd393ca12595cc59181/roles/9fc404ad6efe4526be590d5a1847fbef` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.363938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84cf10c5f6334fd393ca12595cc59181, role_id=9fc404ad6efe4526be590d5a1847fbef)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:46.366338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:46.376326 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 125/252] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Oct 19 00:26:46 2022] PUT /identity/v3/system/users/84cf10c5f6334fd393ca12595cc59181/roles/9fc404ad6efe4526be590d5a1847fbef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:46.450834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d484-067d-43cb-9230-4aaa103b1571 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.491152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.491767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.492071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.492338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.493009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:46.493811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:46.495735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:46.505566 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 128/253] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:46.512278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.537920 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:46.635079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07be83-45b1-453b-b874-d8ec27f0366b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.676192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.676831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.677110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.677384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] PATH_INFO: `/v3/users/ac3784cf2c2646eb913f9177eef6c401` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.678522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3784cf2c2646eb913f9177eef6c401)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:46.680047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f0af-1861-4b9d-aef3-312827a3a9b6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:46.682613 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 126/254] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:46 2022] GET /identity/v3/users/ac3784cf2c2646eb913f9177eef6c401 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:46.688446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:46.776019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:46.801072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44941a-1045-4623-8812-da9092c2e9b6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:46.840228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:46.841095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:46.841383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:46.841661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:46.842393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] RBAC: Adding query filter params (role.id=2c9e8a9da54c45a0b7b872570a089d91, user.id=ac3784cf2c2646eb913f9177eef6c401, scope.system=all) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:46.842695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:46.844183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4475-6cd4-4739-a7d3-49c2ccd759f3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:46.858009 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 129/255] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Oct 19 00:26:46 2022] GET /identity/v3/role_assignments?user.id=ac3784cf2c2646eb913f9177eef6c401&scope.system=all&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:48.432683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24333-c274-4a78-938b-206d9e48ab3b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.433293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24333-c274-4a78-938b-206d9e48ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.433293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24333-c274-4a78-938b-206d9e48ab3b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.434884 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 127/256] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:48.440137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a66ec-dde0-43c1-8d3e-240071bd247b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.440994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a66ec-dde0-43c1-8d3e-240071bd247b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.441544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a66ec-dde0-43c1-8d3e-240071bd247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.470524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b34a66ec-dde0-43c1-8d3e-240071bd247b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:48.472135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b34a66ec-dde0-43c1-8d3e-240071bd247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:48.551247 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 130/257] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:26:48.700048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd47ba-fcec-4735-8912-3b9539a6f149 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.700666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd47ba-fcec-4735-8912-3b9539a6f149 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.701132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd47ba-fcec-4735-8912-3b9539a6f149 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.702668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 128/258] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:48.708156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188854c4-a4fc-4f76-879f-2b1893379197 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.708676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188854c4-a4fc-4f76-879f-2b1893379197 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.709175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188854c4-a4fc-4f76-879f-2b1893379197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.732351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-188854c4-a4fc-4f76-879f-2b1893379197 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:48.733924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-188854c4-a4fc-4f76-879f-2b1893379197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:48.750274 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 131/259] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:26:48.859656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8d6f-1f47-48e7-a186-28c1b41126dc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.860013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8d6f-1f47-48e7-a186-28c1b41126dc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.860272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8d6f-1f47-48e7-a186-28c1b41126dc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.861813 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 129/260] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:48.867115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.867397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.867667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.896938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:48.898249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:48.907779 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 132/261] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:26:49.137496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb8d6f-1f47-48e7-a186-28c1b41126dc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.151158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb8d6f-1f47-48e7-a186-28c1b41126dc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.157823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.158668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.159137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.159619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.173875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:49.179434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:49.180335 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:49.181515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:49.186986 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 130/262] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:49.192040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.203422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275720d-70ba-4bf1-ac38-164fea59a9eb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.208022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.208839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.209308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.209789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.210656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.211149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.213838 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:26:49.213838 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:26:49.213838 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:26:49.215108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.229245 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 133/263] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.235052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.245698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f14418-346c-401a-bf25-7b5495ed3706 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.250383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.251264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.251736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.252235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.259826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.261889 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:26:49.261889 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:26:49.261889 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:26:49.263459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.268249 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 131/264] 10.222.0.33 () {56 vars in 1201 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.271560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.282811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209b677-5fdf-412d-bc67-b3a91a5ababe admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.287491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.288357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.288894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.289378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.291316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.295705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.297597 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 134/265] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.303709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.315107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7127-9dd6-479a-ac8d-fdee704c8367 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.319746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.320672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.321143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.322137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/groups/27a070096c9642af846d734791cf7aaf/roles/42aa243014164140995772918b521a86` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.324556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, group_id=27a070096c9642af846d734791cf7aaf, role_id=42aa243014164140995772918b521a86)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.325793 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:26:49.325793 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:26:49.325793 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:26:49.328113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.346351 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 132/266] 10.222.0.33 () {58 vars in 1463 bytes} [Wed Oct 19 00:26:49 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/groups/27a070096c9642af846d734791cf7aaf/roles/42aa243014164140995772918b521a86 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:49.368815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.380548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca12a99-0260-44dd-98a6-3eb38e976ba8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.381940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.516828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.518258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.521193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.521817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.529714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:49.535431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb8f0-1c2f-4eab-8d81-abcb0aa27d70 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.548426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.549388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.550148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.550938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:49.551393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:49.564598 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:49.565567 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:49.568222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:49.570500 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 135/267] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:49.576364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.586241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:49.594573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:49.595455 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:49.596255 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 133/268] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:49.602270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5eba4-063f-4c10-a711-02c632956a62 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.602432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.620956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.622637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.623614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.624121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.624995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.625488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.627898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.635739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc358-9276-41ba-950c-a08715836cb7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.641037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.641685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.641958 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.642225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.642960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.643253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.644372 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:26:49.644372 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:26:49.644372 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:26:49.645263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.651025 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 136/269] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:49.659519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.660372 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 134/270] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:49.671233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.679423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640720-68aa-4bb4-8c68-34bdea263785 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.686552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d707e-bbbc-4f36-9461-815d5aaa8b5c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.691753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.691914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.692437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.692633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.692727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.692868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.693010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.693107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.694096 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.694995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.695166 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:26:49.695166 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:26:49.695166 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:26:49.696508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.697321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8388a7c-5fb8-49ae-84c7-a58d2cfb891a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.698968 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 135/271] 10.222.0.33 () {56 vars in 1201 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:49.702856 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 137/272] 10.222.0.33 () {56 vars in 1201 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.703673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.704106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74f3-6940-41ef-bbd3-77250ba43323 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.704330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74f3-6940-41ef-bbd3-77250ba43323 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.704683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74f3-6940-41ef-bbd3-77250ba43323 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.706077 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 136/273] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:49.708204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc74f3-6940-41ef-bbd3-77250ba43323 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.717942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c649d4-3dc9-44c0-ab4d-3b8de4108107 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.726257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.726910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.727189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.727466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.729055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc74f3-6940-41ef-bbd3-77250ba43323 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.730727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.732873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62914-5d24-446e-88ef-32486c4e778c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.734574 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 138/274] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.735744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b915d1-9f36-420d-8f14-61e9a5fbe8e4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.736277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.737123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.737591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.738048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.739468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.740206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b915d1-9f36-420d-8f14-61e9a5fbe8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.740514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b915d1-9f36-420d-8f14-61e9a5fbe8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.747484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.747484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 137/275] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:49.747484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.763047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4a1f-6c29-4bbc-a998-1bdcccc26b66 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.771927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.772594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.772867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.773187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/groups/27a070096c9642af846d734791cf7aaf/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.773504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-37b915d1-9f36-420d-8f14-61e9a5fbe8e4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:49.775799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37b915d1-9f36-420d-8f14-61e9a5fbe8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:49.776701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, group_id=27a070096c9642af846d734791cf7aaf, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.779419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.803592 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 138/276] 10.222.0.33 () {58 vars in 1463 bytes} [Wed Oct 19 00:26:49 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/groups/27a070096c9642af846d734791cf7aaf/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:49.804441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.914742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ee3d-ea90-4d39-919e-5e247210ca71 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.920702 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 139/277] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:49.928823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.929934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.930414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.931057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/groups/27a070096c9642af846d734791cf7aaf/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.933756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a05bcd560340f3b1dc414c362ebf68, group_id=27a070096c9642af846d734791cf7aaf, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.936689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5778d7-5969-4641-91e5-9ccedd312613 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.965371 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 139/278] 10.222.0.33 () {58 vars in 1463 bytes} [Wed Oct 19 00:26:49 2022] PUT /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68/groups/27a070096c9642af846d734791cf7aaf/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:50.312457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5883eb-fec8-4013-9ec6-6a95b4f6a4d1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:50.313299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5883eb-fec8-4013-9ec6-6a95b4f6a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:50.314054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5883eb-fec8-4013-9ec6-6a95b4f6a4d1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:50.316720 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 140/279] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:50.324570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:50.325161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:50.325631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:50.362993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:50.364565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:50.462705 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 140/280] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:26:50.479309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5883eb-fec8-4013-9ec6-6a95b4f6a4d1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:50.648710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5883eb-fec8-4013-9ec6-6a95b4f6a4d1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:50.661830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:50.710187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:50.710823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:50.711096 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:50.711363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:50.730274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:50.735385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:50.736327 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:50.737717 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 141/281] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:50.743120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:50.827051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:50.893733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c7b0-5983-42bd-94ca-dac8a33f0d60 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:50.941500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:50.942116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:50.942426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:50.942699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:50.943380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:50.943685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:50.945103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:50.960216 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 141/282] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:50.966800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.064674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.091072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7329e-b5ab-47a9-aeb5-beb2f579fb2a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.101587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.102274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.102639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.102913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.125870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:51.131461 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:51.132467 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:51.134864 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 142/283] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:51.141035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.151032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaac6d-6c73-46ea-a845-2975157a7997 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.157434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc70f-e8b0-4103-bec9-2e5ceed1ccb3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.167886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.168579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.168856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.169123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.169851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:51.170157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.171788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.187757 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 143/284] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Oct 19 00:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:51.193130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.205246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67398a9-a277-4dce-95a1-8eb6ef165582 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.210007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.210641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.211017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.211297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.212551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.214825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.217601 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 144/285] 10.222.0.33 () {56 vars in 1201 bytes} [Wed Oct 19 00:26:51 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:51.224009 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.236516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064302-8761-4bdd-bf9d-73494d851bd6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.244402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.244774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.245179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.245370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.245520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.245663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.245814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] PATH_INFO: `/v3/users/84cf10c5f6334fd393ca12595cc59181` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.245956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.246916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.247083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] RBAC: Authorizing `identity:get_user(user_id=84cf10c5f6334fd393ca12595cc59181)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.248593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.249155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.250528 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 142/286] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:26:50 2022] GET /identity/v3/users/84cf10c5f6334fd393ca12595cc59181 => generated 293 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:51.251124 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 145/287] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:26:51 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:51.256880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.257884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:51.274059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb96be-eaf6-423c-b78d-84b96e1c5a7d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.285316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.286186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.286543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.286827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42/groups/27a070096c9642af846d734791cf7aaf/roles/42aa243014164140995772918b521a86` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.293217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=0280a594f52b465ab158ea7030fd3e42, group_id=27a070096c9642af846d734791cf7aaf, role_id=42aa243014164140995772918b521a86)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.295931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76d17-4776-40cb-b33b-095bb5ad8ace admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.315838 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 146/288] 10.222.0.33 () {58 vars in 1463 bytes} [Wed Oct 19 00:26:51 2022] PUT /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42/groups/27a070096c9642af846d734791cf7aaf/roles/42aa243014164140995772918b521a86 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:26:51.362326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:51.445201 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23879-6abe-4c14-8cd6-a28968a507e8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:51.500528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:51.501144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.501421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.501690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.502428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] RBAC: Adding query filter params (role.id=9fc404ad6efe4526be590d5a1847fbef, user.id=84cf10c5f6334fd393ca12595cc59181, scope.system=all) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:51.502734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:51.504225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5048c-61bc-497b-9650-fb0d651b7312 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:51.524196 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 143/289] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Oct 19 00:26:51 2022] GET /identity/v3/role_assignments?user.id=84cf10c5f6334fd393ca12595cc59181&scope.system=all&role.id=9fc404ad6efe4526be590d5a1847fbef => generated 510 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:51.687038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2a3b-5a54-4bde-b747-01dd41267b57 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.687360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2a3b-5a54-4bde-b747-01dd41267b57 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.687599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2a3b-5a54-4bde-b747-01dd41267b57 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.689560 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 147/290] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:51.698012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.698510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.698510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.720941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:51.722161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:51.797516 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 144/291] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:26:52.232690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d2a3b-5a54-4bde-b747-01dd41267b57 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.246510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d2a3b-5a54-4bde-b747-01dd41267b57 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.254060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.254709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.254988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.255412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.273039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:52.278206 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:52.279083 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:52.279896 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 148/292] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:52.285286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.299999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128484a1-348c-4c72-8942-02379f8b3a22 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.313459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.314079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.314360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.314633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.315316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:52.315618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.317295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.330694 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 145/293] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:52.336165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.346690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd49c9-5c4a-411a-86e2-79c8756dad07 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.352359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.353571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.353964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.354263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] PATH_INFO: `/v3/groups/d25e9c6e986547b3b60b288a10388231` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.359547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] RBAC: Authorizing `identity:get_group(group_id=d25e9c6e986547b3b60b288a10388231)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.361572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.365728 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 149/294] 10.222.0.33 () {56 vars in 1201 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/groups/d25e9c6e986547b3b60b288a10388231 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:52.370987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.386182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f41b08-7878-4d85-b2f9-70e0789ccfa4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.396244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.396874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.397155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.397429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] PATH_INFO: `/v3/projects/303c1157509f409d8afed7ca58b4e513` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.404543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] RBAC: Authorizing `identity:get_project(project_id=303c1157509f409d8afed7ca58b4e513)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.406381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5686-3b62-410a-9da8-8784e675c7ff admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.408326 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 146/295] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/projects/303c1157509f409d8afed7ca58b4e513 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:52.414050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.425223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037083-2288-460e-9c3e-c1f491aef5ae admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.432792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.433452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.433819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.434093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] PATH_INFO: `/v3/projects/303c1157509f409d8afed7ca58b4e513/groups/d25e9c6e986547b3b60b288a10388231/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.436190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=303c1157509f409d8afed7ca58b4e513, group_id=d25e9c6e986547b3b60b288a10388231, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.439085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17cd0b-fb1a-4c2b-93e3-bd6967103f2a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.470861 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 150/296] 10.222.0.33 () {58 vars in 1463 bytes} [Wed Oct 19 00:26:52 2022] PUT /identity/v3/projects/303c1157509f409d8afed7ca58b4e513/groups/d25e9c6e986547b3b60b288a10388231/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:52.657685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0750d5-4d7b-4ac0-afb5-d2eaec149610 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.658006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0750d5-4d7b-4ac0-afb5-d2eaec149610 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.658229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0750d5-4d7b-4ac0-afb5-d2eaec149610 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.659904 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 147/297] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:52.665296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f3a0-4bc9-4c8d-8340-60ed2c1bce59 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.665695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f3a0-4bc9-4c8d-8340-60ed2c1bce59 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.665855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f3a0-4bc9-4c8d-8340-60ed2c1bce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.694442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7003f3a0-4bc9-4c8d-8340-60ed2c1bce59 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:52.695697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7003f3a0-4bc9-4c8d-8340-60ed2c1bce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:52.746039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:52.786885 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 151/298] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:53.191470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0750d5-4d7b-4ac0-afb5-d2eaec149610 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:53.235401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:53.263743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170310b-0783-4834-89fc-9022414929d9 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.264741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170310b-0783-4834-89fc-9022414929d9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.265217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170310b-0783-4834-89fc-9022414929d9 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.267015 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 152/299] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:53.277353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108910a-a7d7-4712-b83f-b143c1142ab6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.277780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108910a-a7d7-4712-b83f-b143c1142ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.278161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108910a-a7d7-4712-b83f-b143c1142ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.303592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f108910a-a7d7-4712-b83f-b143c1142ab6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:53.307782 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f108910a-a7d7-4712-b83f-b143c1142ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:53.353768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0750d5-4d7b-4ac0-afb5-d2eaec149610 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:53.395884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:53.395884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.395884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.395884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.396528 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:53.398110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f22-068d-4ea9-b978-f1c7c5758a28 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.398589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f22-068d-4ea9-b978-f1c7c5758a28 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.399050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f22-068d-4ea9-b978-f1c7c5758a28 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.401751 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 154/301] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:53.411350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.411960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.412533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.416970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:53.425288 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:53.426347 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 148/302] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:53.435010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:53.442800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:53.444264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:53.555477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:53.574457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd93ec-067e-46f2-8357-3dad54bb9212 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:53.616516 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 155/303] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:53.623256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:53.624147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.624569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.625021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.625827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:53.626272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:53.627900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:53.643392 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 149/304] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:53.649401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:53.688076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:53.748833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:53.797946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d7bf-6533-408a-be0b-15a9fee1bbb1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:53.861829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:53.862432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.862704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.862972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:53.920099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bce51-9583-4fb3-99f4-4f363566248f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:53.984066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:53.985559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:53.988898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:53.989539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:53.989811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:53.990076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.014129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:54.022539 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:54.023468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:54.024300 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 150/305] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:54.025480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.039521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.050384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.141432 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 156/306] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:54.142505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.168275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a379ce-23c8-4cbb-b681-de83af46bc9e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.216953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.217568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.217826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.218006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.232428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:54.240369 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:54.241289 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:26:54.242090 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:26:54.242714 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 151/307] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:54.243871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.271805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df20c4a-437d-48a9-a965-4a91a9065fd1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.305774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.316689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.317267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.317496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.317753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.318419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:54.318721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:54.320124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:54.329597 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 157/308] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:54.330416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.331205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.380101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d556f9-2967-4a2f-b5b5-385cf35ee57b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.438052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.439078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.439576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.440696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.442368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:54.445020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:54.448271 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 152/309] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:54.449509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.453535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dde5c-55d5-4da3-9da1-8fc90f6a5064 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.499500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.500450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.500912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.501387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.502229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:54.503179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:54.504775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:54.516426 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 158/310] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:54.518295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.577438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021149-f91b-46d6-aa72-6145a012c1a7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.588597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.626635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.627251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.627529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.628170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.631547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.666149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b17549-2e8f-40a3-868c-cfc5684d3c08 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.713376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.714147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.714438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.714709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.716196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:54.717649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afdb3a-4207-4764-b4ec-9e49ef693fbd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:54.719451 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 159/311] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:54.720894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551931f9-c2ea-481e-a9b8-c7656b68c83f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.721176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551931f9-c2ea-481e-a9b8-c7656b68c83f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.721451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551931f9-c2ea-481e-a9b8-c7656b68c83f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.722769 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 160/312] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:54.723354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551931f9-c2ea-481e-a9b8-c7656b68c83f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.725509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:54.727282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc17e2-fdc8-4de1-b6b9-3e90823d4e0f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:54.854012 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 153/313] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:54.855643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.856193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.856687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.856791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551931f9-c2ea-481e-a9b8-c7656b68c83f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:54.876478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:54.877689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:54.884716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.906066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:54.906681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.906957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.907227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.914170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:54.961581 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 154/314] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:54.962993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:54.998951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.001979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.078702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2519622-89fe-4006-b0c7-7d2b626e92e8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.134607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.135228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.135507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.135779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.137033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] RBAC: Adding query filter params (group.id=27a070096c9642af846d734791cf7aaf, role.id=42aa243014164140995772918b521a86, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:55.137350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.139205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.147476 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 155/315] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/role_assignments?group.id=27a070096c9642af846d734791cf7aaf&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=42aa243014164140995772918b521a86 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.148671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.150538 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 161/316] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:55.166320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.215771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.229934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.317454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef50d-9b4e-4639-94c0-1b2c326c75fa None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.368101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.368767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.369220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.369513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] PATH_INFO: `/v3/projects/a7a05bcd560340f3b1dc414c362ebf68` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.370376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318f2c-c855-4631-8ab4-c3a77fc05fd7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.370743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a05bcd560340f3b1dc414c362ebf68)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.372393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.375015 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 162/317] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/projects/a7a05bcd560340f3b1dc414c362ebf68 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.375822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.416248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.416801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.417083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.417423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.419247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.421631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.422858 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 156/318] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.423538 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.496218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.508471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b53e3-e84c-4fdc-8835-67487822aa60 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.544297 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.548541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1d52-e9c9-4b0a-9cbc-5b96c449d6bf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.550919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.552417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.552703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.552978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.567769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:55.573798 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:55.574754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:26:55.575605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:55.578287 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 163/319] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:55.578287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.591491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.592254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.592605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.592945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.595229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.596479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c066-b138-4787-a224-e73a5e031eb4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.598294 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 157/320] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.599270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b552-d920-410c-89e1-f25ccf1f6939 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.599549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b552-d920-410c-89e1-f25ccf1f6939 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.600110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b552-d920-410c-89e1-f25ccf1f6939 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.601312 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 158/321] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:55.602009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b552-d920-410c-89e1-f25ccf1f6939 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.707439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42b09-be40-4284-b571-c0b7cbc3c5f7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.728600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b552-d920-410c-89e1-f25ccf1f6939 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.752581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.753207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.753484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.753753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.754866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.756349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804d3f6-50e1-46ae-a73b-37509c543255 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.757913 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 164/322] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.759589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.759882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.760178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.769769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.770384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.770659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.771777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.772476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:55.772773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.774173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.778653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:55.779859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:55.785070 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 159/323] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.786483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.798520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.816871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:55.854193 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 165/324] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:26:55.855036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.890444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782c3e-5f7c-46cd-85a2-5dcea91a2a0a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.927438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.928064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.928343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.928613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.929339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] RBAC: Adding query filter params (group.id=27a070096c9642af846d734791cf7aaf, role.id=2c9e8a9da54c45a0b7b872570a089d91, scope.project.id=a7a05bcd560340f3b1dc414c362ebf68) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:55.929645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.931730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.937600 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 160/325] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/role_assignments?group.id=27a070096c9642af846d734791cf7aaf&scope.project.id=a7a05bcd560340f3b1dc414c362ebf68&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:55.938394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.975934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ec7a5-1374-463e-8d75-13f089fe9c2a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.015355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.016113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.016465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.016809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.017670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] RBAC: Adding query filter params (group.id=27a070096c9642af846d734791cf7aaf, role.id=2c9e8a9da54c45a0b7b872570a089d91, scope.project.id=0280a594f52b465ab158ea7030fd3e42) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:56.018050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.019736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.027059 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 166/326] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/role_assignments?group.id=27a070096c9642af846d734791cf7aaf&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=2c9e8a9da54c45a0b7b872570a089d91 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:56.051385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.067481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f60d-ee5c-4983-9b2b-f9bcce81d747 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.110917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.111551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.111828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.112137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.134643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.158405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.205944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.207718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.278556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954c9c-8e27-4515-8d7f-0d67336ca944 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.317006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.317643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.318157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.318157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.329943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:56.334555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:56.335595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:56.336522 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:26:56.338148 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 167/327] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:56.343210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.352239 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 161/328] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:26:56.358317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.431649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.470600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117156-c295-4e8c-9748-b88bb7329e47 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.482142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cafb-3b83-4e36-bed8-f58e96ef5215 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.513519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.514139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.514406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.514676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.515337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:56.515638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.517048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.519600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.520250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.520527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.520794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] PATH_INFO: `/v3/projects/0280a594f52b465ab158ea7030fd3e42` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.522783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] RBAC: Authorizing `identity:get_project(project_id=0280a594f52b465ab158ea7030fd3e42)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.524774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.526909 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 162/329] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/projects/0280a594f52b465ab158ea7030fd3e42 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:56.531561 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 168/330] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:56.532663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.532960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.601300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.651771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb49ce-730a-40fa-8eba-4276b79a9707 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.668457 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1339d-80ef-4789-baa9-724617d06b3c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.693085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.693719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.693995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.694267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] PATH_INFO: `/v3/groups/27a070096c9642af846d734791cf7aaf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.695376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] RBAC: Authorizing `identity:get_group(group_id=27a070096c9642af846d734791cf7aaf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.699022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.699495 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 163/331] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/groups/27a070096c9642af846d734791cf7aaf => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:56.705175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:56.708343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.708948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.709224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.709487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.712632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.787140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.788545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.807715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e390fe-eeb3-4918-b029-d9ec572cdca5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:56.833689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:56.842960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:56.843553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:56.843828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:56.844127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:56.844848 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] RBAC: Adding query filter params (group.id=27a070096c9642af846d734791cf7aaf, role.id=42aa243014164140995772918b521a86, scope.project.id=0280a594f52b465ab158ea7030fd3e42) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:56.845147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:56.846578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:56.852929 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 164/332] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/role_assignments?group.id=27a070096c9642af846d734791cf7aaf&scope.project.id=0280a594f52b465ab158ea7030fd3e42&role.id=42aa243014164140995772918b521a86 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:56.889022 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 169/333] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:26:56.894703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:57.003035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31442b59-a90c-492c-b6cb-92915b129c50 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:57.040636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:57.040873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.041149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.041419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] PATH_INFO: `/v3/projects/303c1157509f409d8afed7ca58b4e513` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.042806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] RBAC: Authorizing `identity:get_project(project_id=303c1157509f409d8afed7ca58b4e513)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:57.044279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:57.045903 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 165/334] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:26:56 2022] GET /identity/v3/projects/303c1157509f409d8afed7ca58b4e513 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:57.051466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:57.086856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:57.155740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ff4da-c4d1-4f65-87e3-6cfab16edf40 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:57.190608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:57.191235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.191515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.191778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] PATH_INFO: `/v3/groups/d25e9c6e986547b3b60b288a10388231` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.192893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] RBAC: Authorizing `identity:get_group(group_id=d25e9c6e986547b3b60b288a10388231)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:57.194324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163be617-c184-4da2-abec-d60618f515f2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:57.195897 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 170/335] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Oct 19 00:26:57 2022] GET /identity/v3/groups/d25e9c6e986547b3b60b288a10388231 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:57.202537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:57.262464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:57.302911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58280a3-2940-4b5c-b4d4-69be08684175 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:57.335085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:57.335665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.335972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.336244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.337100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] RBAC: Adding query filter params (group.id=d25e9c6e986547b3b60b288a10388231, role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=303c1157509f409d8afed7ca58b4e513) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:57.337494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:57.338917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6034d6-4d28-473f-b687-5bf918359835 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:57.344491 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 166/336] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Oct 19 00:26:57 2022] GET /identity/v3/role_assignments?group.id=d25e9c6e986547b3b60b288a10388231&scope.project.id=303c1157509f409d8afed7ca58b4e513&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:59.824660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c72be-a814-46fd-a510-a4835801a21f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:59.825168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c72be-a814-46fd-a510-a4835801a21f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:59.825241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c72be-a814-46fd-a510-a4835801a21f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:59.826777 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 171/337] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:59.837165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17971-40c2-4f70-ae24-632368440f82 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:59.838041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17971-40c2-4f70-ae24-632368440f82 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:59.838516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17971-40c2-4f70-ae24-632368440f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:59.860910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-25d17971-40c2-4f70-ae24-632368440f82 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:59.862448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-25d17971-40c2-4f70-ae24-632368440f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:59.953204 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 167/338] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:00.248486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515cfee-9413-42b6-bd66-e4224e5bc845 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.249116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515cfee-9413-42b6-bd66-e4224e5bc845 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.249604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515cfee-9413-42b6-bd66-e4224e5bc845 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.251366 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 172/339] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:00.262164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2875-722a-4f59-9bb3-a6b940d569a8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.262764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2875-722a-4f59-9bb3-a6b940d569a8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.263241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2875-722a-4f59-9bb3-a6b940d569a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.287296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-323d2875-722a-4f59-9bb3-a6b940d569a8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:00.288850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-323d2875-722a-4f59-9bb3-a6b940d569a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:00.357740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.387603 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 168/340] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:00.446964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04261-03fd-47d4-913c-e775a4f2ca03 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.447653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04261-03fd-47d4-913c-e775a4f2ca03 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.448161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04261-03fd-47d4-913c-e775a4f2ca03 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.449727 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 173/341] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:00.455333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.455625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.455910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.466465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04261-03fd-47d4-913c-e775a4f2ca03 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:00.484322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:00.485507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:00.590045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04261-03fd-47d4-913c-e775a4f2ca03 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:00.592711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.619234 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 169/342] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:00.647395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:00.648066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.648346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.648616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.668337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:00.670193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:00.685670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:00.686631 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:00.687468 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:00.687468 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:00.687468 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:00.692322 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 174/343] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:00.698293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:00.730936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:00.817925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d2ad-ba27-4041-abb4-9e96ec59a018 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:00.832443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.840497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf59a81-da6c-490d-9440-8b04fad390cd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:00.855335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:00.856004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.856287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.856608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.857292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:00.857635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:00.859012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a741-b0c0-4010-aa3a-0aabbbc0b885 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:00.871811 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 170/344] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:00.873295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24c10d-091c-4805-ad32-0670bc678103 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.873581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24c10d-091c-4805-ad32-0670bc678103 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.873860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24c10d-091c-4805-ad32-0670bc678103 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.879405 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 171/345] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:00.880292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24c10d-091c-4805-ad32-0670bc678103 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:00.882967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:00.883844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.884338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.884815 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.897057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:00.898755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-fe08332c-a3da-49f2-971c-35702dceae71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:00.914740 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:00.916444 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:00.917330 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:00.917330 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:00.917330 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:00.919164 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 175/346] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:00.920634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.921127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.921603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.938158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.944089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:00.945760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:00.996573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24c10d-091c-4805-ad32-0670bc678103 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.023907 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 176/347] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:01.023907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.041104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.041439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.041672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.041944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.042593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.044062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.077682 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 172/348] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:00 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:01.078955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.140644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.158586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7df9ad-ec77-4077-b32e-919a9750ea72 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.213410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.214976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.215587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.216169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.217274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:01.218189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.220312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.225029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.227597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e01f-a3c7-4ba0-92d1-7bdec02475b0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.242741 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 177/349] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:01.253554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.299087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.299836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.300191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.300466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.316677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.318432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:01.340697 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:01.345020 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:01.345935 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:01.345935 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:01.345935 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:01.345935 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 173/350] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:01.345935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.405891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12175-d795-4042-b165-68089fd4775f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.443194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.443869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.444175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.444452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.445146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.446938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.457467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.472121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1279c-f8af-4221-92aa-7cc22c246ba9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.472577 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 178/351] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:01 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:01.473735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.513339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.514080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.514362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.514714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.527591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.529592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.540587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:01.545822 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:01.546820 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:01.553024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:01.553024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:01.553024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:01.553024 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 174/352] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:01.556146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.605397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8150-8b55-4b0c-aa43-46d00cb9be7b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.646145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.647155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.647630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.648240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.649750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:01.650272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.652041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.672157 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 179/353] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:01.674045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.691175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1803a-2b04-4abb-90a7-8476b91b962b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.765719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.766394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.766677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.767005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.767694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:01.768036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.770630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.772994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.801210 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 175/354] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:01.802839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a01b-62b3-4d19-849a-05a4b6e6eff3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.812012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.820173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.843682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.845120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.845402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.845675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.846323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.847753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae0bc-d286-428f-9b5f-19bfaa8c9218 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.879275 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 180/355] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:01 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:01.908719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34336e-1361-4a34-9b81-fa2fa99c8d2f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.909024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34336e-1361-4a34-9b81-fa2fa99c8d2f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.909274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34336e-1361-4a34-9b81-fa2fa99c8d2f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.910608 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 181/356] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:01.918506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.918690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.918894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.940752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:01.941987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:01.968287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8890f9-5adf-4297-aa13-90969a8f11db None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:02.011421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:02.012522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:02.013113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:02.013564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:02.014468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:02.016284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:02.032544 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 182/357] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:02.045239 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 176/358] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:01 2022] POST /identity/v3/users => generated 249 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:02.315315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:02.416609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:02.420452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0fce1-77e5-4ead-aa3f-ef3ffc923a6d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:02.470062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:02.470677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:02.470956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:02.471227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:02.471919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:02.473306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:02.490675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:27:02.490675 dv-cinder-master-3-smb devstack@keystone.service[81723]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:27:02.490675 dv-cinder-master-3-smb devstack@keystone.service[81723]: [parameters: {'id': 'd889a20e53d0424f886b3d0f0c7248eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:27:02.490675 dv-cinder-master-3-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:02.497705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return ref.to_dict() Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:02.498597 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:27:02.499546 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:27:02.500500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:02.501383 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:02.504007 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'id': 'd889a20e53d0424f886b3d0f0c7248eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:02.506266 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:27:02.512363 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:02.513387 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 183/359] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Oct 19 00:27:02 2022] POST /identity/v3/roles => generated 144 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:02.513466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:02.591140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:02.660980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85013d-d986-4f2f-b7e9-58b43bf2071e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:02.715308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:02.715964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:02.716243 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:02.716511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:02.731350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-5e9dcb2a-10f3-4d82-b584-9e804d5f127e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:02.736782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:02.737855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:02.739050 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 177/360] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:02.743864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:02.896197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97e04-7b0a-42d3-8a37-579f87610052 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:02.949512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:02.950130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:02.950408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:02.950676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:02.951346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:02.951710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:02.953188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2918-3546-4722-8b56-5f40d076be98 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:02.965902 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 184/361] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:03.673439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f60306-7333-41fc-af70-3a0c52426ed6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:03.673967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f60306-7333-41fc-af70-3a0c52426ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:03.673967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f60306-7333-41fc-af70-3a0c52426ed6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:03.675628 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 178/362] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:03.680815 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe2e8-701e-443f-8134-ce97a15961b7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:03.681102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe2e8-701e-443f-8134-ce97a15961b7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:03.681458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe2e8-701e-443f-8134-ce97a15961b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:03.704439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a0efe2e8-701e-443f-8134-ce97a15961b7 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:03.705631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a0efe2e8-701e-443f-8134-ce97a15961b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:03.732555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:03.797419 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 185/363] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:04.221277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f60306-7333-41fc-af70-3a0c52426ed6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:04.318251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78f0a-52e0-4c61-a0de-a073e54df66d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.318251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78f0a-52e0-4c61-a0de-a073e54df66d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.318251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78f0a-52e0-4c61-a0de-a073e54df66d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.319283 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 186/364] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:04.326488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda648-0fc7-4ff0-8b48-b8b834e9bd09 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.326771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda648-0fc7-4ff0-8b48-b8b834e9bd09 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.327043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda648-0fc7-4ff0-8b48-b8b834e9bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.361606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0cdda648-0fc7-4ff0-8b48-b8b834e9bd09 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:04.362792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0cdda648-0fc7-4ff0-8b48-b8b834e9bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:04.379756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f60306-7333-41fc-af70-3a0c52426ed6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:04.401068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:04.450258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:04.450885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.451157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.451419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.476049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:04.486673 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:04.487642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:04.488973 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 179/365] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:04.496094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:04.509521 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 187/366] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:04.592001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06d82b-a411-49e0-9c89-2e7dc9e4af99 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.592648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06d82b-a411-49e0-9c89-2e7dc9e4af99 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.593119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06d82b-a411-49e0-9c89-2e7dc9e4af99 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.595845 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 188/367] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:04.600351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.600863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.601356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.621368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:04.622892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:04.684090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56362-0dd3-4757-81ac-a0796fb7d615 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:04.699003 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 189/368] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:04.724458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:04.725735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.726298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.726797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.727965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:04.728526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:04.730150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:04.738970 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 180/369] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:04.744673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:04.780980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:04.894875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984ab68-0a7d-4b37-b824-5c6aaf315266 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:04.909576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:04.932135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:04.933098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.933577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.934069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.944120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:04.948054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:04.950533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-34f24bc3-9400-4cc8-a397-d7132480bb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:04.971441 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:04.972671 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:04.973757 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:04.973757 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:04.973757 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:04.976393 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 190/370] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:04.982497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd3f9-f590-4027-826a-de0311eec2ba None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:04.982497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd3f9-f590-4027-826a-de0311eec2ba None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:04.982497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd3f9-f590-4027-826a-de0311eec2ba None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:04.982497 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 191/371] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:04.986418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebd3f9-f590-4027-826a-de0311eec2ba None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.048323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3fc1-e1c4-4287-88ee-35be6fefad86 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.057057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.089613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.090247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.090530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.090806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.094467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebd3f9-f590-4027-826a-de0311eec2ba None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.101446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8a8449bf-fca8-4228-852c-cfc4c314bc6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:05.107608 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.108579 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:05.109403 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 181/372] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:05.110066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.110176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.110448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.129191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:05.130388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:05.140751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.141354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.141631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.142279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.142926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:05.143229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.144966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.157482 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 192/373] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:05.158322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.216065 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 182/374] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:05.217218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.252663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.278485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1693a-77dc-4759-b435-629d296ea7f3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.309085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.320534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.322792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.323252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.323666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.338472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:05.346593 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.347662 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.348563 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:05.351986 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 193/375] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:05.354041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.357246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc43e-bece-4f18-92f4-f002e17a9851 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.393649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09468358-004f-495a-bade-dd211992440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.394259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468358-004f-495a-bade-dd211992440c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.394558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468358-004f-495a-bade-dd211992440c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.394992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468358-004f-495a-bade-dd211992440c None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.395573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09468358-004f-495a-bade-dd211992440c None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:05.395906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09468358-004f-495a-bade-dd211992440c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.397348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09468358-004f-495a-bade-dd211992440c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.407019 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 183/376] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:05.407959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09468358-004f-495a-bade-dd211992440c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.492947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f04fa-9aa2-4163-9c26-e249996e70b9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.504936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.522095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09468358-004f-495a-bade-dd211992440c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.535012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.535634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.535939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.536213 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.545316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.546759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.558639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.559246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.559528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:05.559773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.560665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:05.561578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:05.562703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.562703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:05.562703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.562703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.565589 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 194/377] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:05.566422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.570674 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 184/378] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:05.576563 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.618090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.682395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5cdd-e1ba-4d45-a7e6-1b52fc265b43 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.686093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d661-81e6-4aad-9b1e-24190b4e7f50 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.719006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.719629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.719934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.720216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.721370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.721999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.722277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.722549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.732294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.733754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.734052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:05.740406 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.741300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:05.742083 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 185/379] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:05.743255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.752743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:05.754445 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.755385 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:05.757299 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:05.757299 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:05.757299 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:05.757299 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 195/380] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:05.757299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.856432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4bb-94a8-4059-9b23-04a7a02821c9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.866819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:05.871662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258a67-7e33-4ea4-ae0f-415164402a34 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:05.892483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.893344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.893624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.893892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.894622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:05.894924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.896401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.910044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:05.910661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:05.910941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:05.911206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:05.925041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:05.926675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:05.934382 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 186/381] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:05.935722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:05.944069 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:05.944992 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:05.945860 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:05.945860 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:05.945860 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:05.945860 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 196/382] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:05.946246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.011248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.052832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7748-9e55-43fc-9363-6e52c82cea5b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.068206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8f967-9d11-4f95-be3a-2dbeca693e7c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.090246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.090855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.091128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.091403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.092089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.092387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.093763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.101767 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 187/383] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.103150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.112217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.112808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.113079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.113342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.113975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.114270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.115617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.127985 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 197/384] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.128856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.141468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.203635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d163b-a1b2-426a-a601-494b12424167 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.227584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7d54-2ad0-4894-928a-45b737e2fe86 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.228100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.237141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.237948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.238348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.238676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.249472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.250938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.262234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.262760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.263037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.263307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.263968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.264270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.265613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ceb4cd29-329b-452e-a589-8b1f76683593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:06.265729 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:06.266760 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:06.268021 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:06.268021 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:06.268021 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:06.268021 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 188/385] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:06.268425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d8cc-7681-4eb8-bb38-2489f9c64d3f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.268705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d8cc-7681-4eb8-bb38-2489f9c64d3f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.268978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d8cc-7681-4eb8-bb38-2489f9c64d3f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.270207 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 189/386] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:06.270899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d8cc-7681-4eb8-bb38-2489f9c64d3f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 198/387] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.282596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.351788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.380626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d8cc-7681-4eb8-bb38-2489f9c64d3f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.382335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d370e-87ae-4b1b-a94c-d006af06d38e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.414087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.414744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.415021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.415290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.416282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.416891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.417170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.417433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.424681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.426183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.426878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.428358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:06.437313 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:06.438221 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 199/388] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:06.439114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-08bb6910-bce3-437c-863e-d866b6120c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:06.443007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:06.443926 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:06.444782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:06.444782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:06.444782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:06.444782 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 190/389] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:06.445611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.445611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.445611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.463844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:06.465064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:06.488586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.531937 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 191/390] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:06.540868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.547289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958170f-0b1f-48ad-ab36-828ff081f350 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.578307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.585894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.586521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.587530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.587722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.588471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.588741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.590108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.607024 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 200/391] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.607024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.657490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ea8a5-8150-4741-9adb-e3f1f2347f8d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.698892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.699550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.699629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.699949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.707288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.708769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.711842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c720612-e546-4b84-8589-ebe9cf7a2a88 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:06.721863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:06.722766 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:06.723651 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 192/392] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:06.724258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.748198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.752500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.753098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.753472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.753682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.754362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.754664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.756128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.794545 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 201/393] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.795320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.833385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165f91e-1d48-4458-b196-9795edd04205 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.846950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.867771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.868893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.869187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.869450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.870076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:06.870372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.871770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.883178 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 193/394] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:06.884053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.899883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838a9d5-9bd9-484a-8d7a-3dcfcd9ea88a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:06.933039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:06.933810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:06.934089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:06.934359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:06.941083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:06.942550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:06.955152 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:06.956251 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 202/395] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:06.962599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:06.964462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:06.983333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42388cdd-c556-4c00-9111-fb28ad80b2d8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.017069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.017659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.017937 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.018199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.018910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.019206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.020678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.037646 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 194/396] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.038440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.060578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceca5-c4f1-4daf-8dae-9f636b3cfdbc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.069229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.094659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.095277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.095555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.095824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.107353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.108844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:07.123377 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:07.124494 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:07.125440 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:07.125440 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.125440 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:07.125440 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 203/397] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:07.125440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.145583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1f370-8b3e-4796-80e5-f40212c2a57c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.179209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.179831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.180230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.180503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.186995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.190947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.192560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:07.208530 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:07.209663 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:07.210591 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:07.210591 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.210591 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:07.210591 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 195/398] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:07.210591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.228784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6828b-ede8-45dc-9382-177acb86f00f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.263137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.264475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.264750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.265018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.272220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.273665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:07.285573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:07.286676 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:07.287585 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 204/399] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:07.288211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.309639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.318179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee254-75d2-4bd0-a510-94b1fdcefae3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.352803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.353400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.353677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.353944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.354624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.354924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.356391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.374049 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 196/400] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.374843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.389295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29dee-62b9-4bd2-85b7-b75a88990039 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.423044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.423657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.423966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.424242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.426107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.435616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.437128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:07.452002 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:07.452928 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:07.453773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:07.453773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:07.453773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:07.453773 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 205/401] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:07.453999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.479607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506df2d-4f6b-4fde-8329-eca9b8b114d0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.513745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.514344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.514625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.514894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.515532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.515831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.517265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.525873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.529002 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 197/402] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.529835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.559692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040725-66f9-46eb-a1d8-f54874f584fd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.593953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.594559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.594840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.595109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.595738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.596059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.597439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.608590 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 206/403] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.609379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.628972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32124-a529-4040-a775-43ad8ce2cb39 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.640495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.663987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.664585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.665069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.665449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.666180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.666485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.668253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.685420 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 198/404] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.686471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.713295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9084-e00d-4586-8ea8-4e73ad44fb44 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.741966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.748249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.748897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.749171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.749439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.764296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=08d6104d22ff4bb1bd295d99ca3c5ac3, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.765737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.777911 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 207/405] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:07 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:07.778693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.803416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344380-20cb-4992-8339-97c5585080a6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.845645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.846558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.846839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.847109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.847758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:07.848087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.849506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.863845 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 199/406] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:07.864610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.896004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4510e-fd98-446d-a96b-ec63f090c073 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:07.901296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:07.935612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:07.936440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:07.937069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:07.937069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:07.945084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:07.947191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:07.958969 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:07.960082 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:07.960964 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 208/407] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:07.961469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:07.992172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd321-9a1b-4841-91d3-6d13bfffe6d4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.007208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.029847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.030443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.030717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.030982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.031621 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.033131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.054411 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 200/408] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:07 2022] POST /identity/v3/users => generated 247 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:08.055241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.090507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4367e7-5926-4c17-8c0e-80599ad8789e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.134911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.135793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.135793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.136077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.148432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.150751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:08.174776 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:08.175966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:08.176986 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:08.176986 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:08.176986 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:08.176986 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 209/409] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:08.176986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.182192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.204064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e7bcb-ca2a-4c6e-ac04-967cfaeff755 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.251245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.252082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.252465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.252839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.261184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.262942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:08.276160 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:08.277198 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:08.278236 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:08.278797 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 201/410] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:08.283407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.319566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.333297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca05df-7533-493a-ba66-56b24af63841 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.371664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.372312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.372590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.372862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.373551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:08.373858 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.375644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.398620 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 210/411] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:08.400143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.409122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5352c-bd28-40ab-b272-e57eb64112c2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.459197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.459801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.460136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.460770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.461425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:08.462228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.463700 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.481213 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 202/412] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:08.483310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.489755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.525526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfcfba-e53e-492d-b18d-6fd4a34f7f87 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.567728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.569079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.569889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.570594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.572767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:08.573305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.575081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.596293 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 211/413] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:08.596293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.613092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.632183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bda-94e9-4771-bf2e-078f02f0307f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.689220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.689969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.690348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.690715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/6b298c229b7f402c9883e743c82110a8/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.707844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=6b298c229b7f402c9883e743c82110a8, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.709554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.717396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1e17-47a1-4827-870f-f2d24f57c7c2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.726829 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 203/414] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:08 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/6b298c229b7f402c9883e743c82110a8/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:08.729266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.760382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.761235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.761690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.762059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.770174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.771720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:08.785434 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:08.786531 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:08.787578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:08.794008 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 212/415] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:08.796022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:08.812051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.881968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b2b02-bc31-4b77-91e6-f0e96f874055 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:08.927393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:08.928503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:08.928958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:08.929374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/8f4e1ab258e946cb935116e6c71bbd91/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:08.940676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:08.951841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=8f4e1ab258e946cb935116e6c71bbd91, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:08.953853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:08.971191 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 204/416] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:08 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/8f4e1ab258e946cb935116e6c71bbd91/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:08.991222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09909c-1357-488a-b835-002a67f78dac None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:09.034480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:09.035328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:09.035702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:09.036102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:09.036978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:09.037422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:09.039066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db729e8-424c-4844-8b29-2867feeb67aa None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:09.057124 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 213/417] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:09.061378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:09.214452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eed3d-6688-424b-aedc-361968d4f4db None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:09.217151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:09.255387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:09.256093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:09.256376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:09.256656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/8b209bd7afbd44ceabe2d9b71e7585e7/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:09.272766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=8b209bd7afbd44ceabe2d9b71e7585e7, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:09.274824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489baa33-5294-4cc4-8a58-7ea6a0098969 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:09.294100 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 205/418] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:09 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/8b209bd7afbd44ceabe2d9b71e7585e7/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:10.120103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdca-cd5c-4b6c-8eae-2868b0029f55 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:10.120625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdca-cd5c-4b6c-8eae-2868b0029f55 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:10.120625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdca-cd5c-4b6c-8eae-2868b0029f55 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:10.122218 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 214/419] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:10.127713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78549b0-4997-4048-86cf-66461e0e5bc6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:10.128182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78549b0-4997-4048-86cf-66461e0e5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:10.128365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78549b0-4997-4048-86cf-66461e0e5bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:10.146620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d78549b0-4997-4048-86cf-66461e0e5bc6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:10.147831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d78549b0-4997-4048-86cf-66461e0e5bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:10.240207 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 206/420] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:10.570080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bdca-cd5c-4b6c-8eae-2868b0029f55 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:10.701485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bdca-cd5c-4b6c-8eae-2868b0029f55 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:10.718414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba78bd-025c-4388-b101-99739fb5101e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:10.719005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba78bd-025c-4388-b101-99739fb5101e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:10.719480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba78bd-025c-4388-b101-99739fb5101e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:10.721463 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 207/421] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:10.726794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:10.727405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:10.727913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:10.754691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:10.755309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:10.755584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:10.755873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:10.757765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:10.767051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:10.767489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:10.768406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:10.772848 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:10.773806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:10.775156 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 215/422] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:10.782212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:10.859288 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 208/423] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:10.965736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a71e-805d-486a-a74a-00a7ad3e2cf9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.014513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.015110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.015384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.015651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.016334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:11.016636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.018012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:11.030766 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 216/424] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:11.036378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.064906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.184781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa76d8-a026-42eb-815e-93e19a0460f0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.234728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.235645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.236098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.236572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.254108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.255920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:11.278338 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:11.279511 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:11.280615 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:11.280615 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:11.280615 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:11.282298 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 209/425] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:11.287979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.370680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.388770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.448493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7bdc-f5a7-4c50-83bd-9d33d69af8b4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.465866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.489389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.489998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.490276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.490546 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.491186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:11.491482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.493594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdf4cf-df09-481f-b686-e740e2859fac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:11.507893 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 217/426] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:11.509012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c7f1-5abd-4ec3-a363-ae78d7841281 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.509296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c7f1-5abd-4ec3-a363-ae78d7841281 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.509565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c7f1-5abd-4ec3-a363-ae78d7841281 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.511067 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 218/427] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:11.513307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c7f1-5abd-4ec3-a363-ae78d7841281 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.524654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557df99-923a-4e6c-b853-e1a180322aa1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.559450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.560108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.560384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.560654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.571721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-64e0f58e-d635-47be-acfb-74ea2112961c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:11.577215 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:11.578110 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:11.579320 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 210/428] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:11.580270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.580270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.580390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.601589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:11.603317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:11.646387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c7f1-5abd-4ec3-a363-ae78d7841281 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.663873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.687227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.688111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.688544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.688821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.693102 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 211/429] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:11.694114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.705062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.706530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:11.728151 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:11.729264 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:11.730238 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:11.739969 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 219/430] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:11.739969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.797067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.880263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ad96-8210-4708-aa1c-25ae70309b85 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.918552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.919149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.919422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.919689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.920372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:11.920671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.921466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19af8b-927a-4f57-b935-a5e03587ab83 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:11.922044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ba5f-f23d-4e00-afb2-70fbf563e628 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:11.935380 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 212/431] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:11.935380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12f96-6328-498a-9be8-9d68bc4fc80a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.935380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12f96-6328-498a-9be8-9d68bc4fc80a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.935380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12f96-6328-498a-9be8-9d68bc4fc80a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.939076 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 213/432] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:11.940274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12f96-6328-498a-9be8-9d68bc4fc80a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:11.973659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:11.974280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:11.974874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:11.975223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:11.976309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:11.976726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:11.979176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76278-3aa4-48dd-8223-e747d4f6c3e3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.000136 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 220/433] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:12.006224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.006565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.006903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.027516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:12.028765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:12.058926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.061569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12f96-6328-498a-9be8-9d68bc4fc80a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.082033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.099491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.100393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.100671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.100943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.101150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 221/434] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:12.102021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.112550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.114040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:12.128687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.129781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:12.130946 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:12.130946 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.130946 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:12.130946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 214/435] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.130946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.215911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e2bff-df82-41c2-973c-6e1c1287eecd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.235693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b974e9-d7e4-44cd-b0c0-206ed5378d3a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.254939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.255540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.255815 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.256522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.272664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.273278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.273552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.273818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.285443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:12.287629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a1a52b83-9826-45b5-8fea-20afb65e3725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:12.291964 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.292858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:12.293654 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 215/436] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.294307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656a8d-57e1-4464-84d4-fd7bd82226a2 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.294881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656a8d-57e1-4464-84d4-fd7bd82226a2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.294881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656a8d-57e1-4464-84d4-fd7bd82226a2 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.299966 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 216/437] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:12.299966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656a8d-57e1-4464-84d4-fd7bd82226a2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.329697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.340353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.342235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.403613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656a8d-57e1-4464-84d4-fd7bd82226a2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.436356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.436998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.437273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.437540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.438158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:12.438449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.439818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05757f-2d57-4ab7-bf1e-61456237940c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.443657 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 222/438] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:12.444519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.453319 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 217/439] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:12.454635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.454977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.455248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.472459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:12.473647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:12.505259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.539008 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 218/440] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:12.540462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.543746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a966-c92b-4c18-918a-234b8413ba53 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.573452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.579468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.580100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.580380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.580643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.581289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:12.581587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.582927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.593027 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 223/441] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:12.593666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.670186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652004-878c-4e78-90aa-cb87de9cb2d5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.704484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63212-a81d-4b39-bbee-731439fbee79 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.706239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.706851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.707121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.707383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.718499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:12.723251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.724374 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 219/442] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.725427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.736639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.747157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.747785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.748403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.748679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.760714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.762077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:12.777554 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.778500 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:12.779430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:12.779430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.779430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:12.779430 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 224/443] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.780322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.819827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:12.840241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f886a0-6c00-406e-b432-2ee7689f50e3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.873823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.874448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.874721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.874991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.881834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.883360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.884311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f3a3-16a5-4208-92b6-68e9a89903f7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:12.895706 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.896844 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 220/444] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.897759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.921125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:12.921857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:12.922200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:12.922470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:12.933290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:12.934709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:12.949012 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:12.950101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:12.950991 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:12.950991 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:12.950991 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:12.950991 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 225/445] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:12.950991 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:12.980931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.004141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d45e3-6ca5-4757-98c9-c2e6c89b87cc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.037685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.038291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.038974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.039254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.040632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.040927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.042302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.050307 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 221/446] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.050850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a7f0-e406-4f75-b51d-e64864939b1f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.051098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.056759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.087732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.088351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.088654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.088927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.089551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.089846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.091285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.102992 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 226/447] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.103868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.154955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5528-018e-4aec-be2c-8e82db53cbe7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.186986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.187592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.187917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.188184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.191994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.201998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:13.203021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72bf6-fde9-441b-a4e2-331a8352b9b1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:13.207180 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:13.208302 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 222/448] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:13.209415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.242324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.242955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.243227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.243494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.244239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.244535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.245971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.263487 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 227/449] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.264333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.275920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.313802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafee622-bb2f-492f-9860-56225c37be21 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.347012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.347600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.347897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.348170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.348803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.349103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.350724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.361198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6081-5b87-4116-8e7a-9ba05561394e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.362130 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 223/450] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.362929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.398625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.399458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.399572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.399828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.409687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.411107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.420821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:13.427579 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:13.428737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:13.429909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:13.429909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:13.429909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:13.432139 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 228/451] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:13.433127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.462347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd3c6-9dc9-444f-bc84-bf5f31334651 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.486183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.498398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.499012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.499283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.499553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.506077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.507514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:13.519042 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:13.520095 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:13.521170 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 224/452] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:13.521725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.535941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c115cc-9953-4d5d-a682-261c76e25e8c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.569499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.570025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.570303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.570579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.571432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.571733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.573164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.580824 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 229/453] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.581605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.624053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fd7c-aaaa-4b0f-a252-7713c396d135 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.643633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.658046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.659039 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.659326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.659591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.670560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.672029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.683381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993d33e-7564-40aa-8c57-8bfb7ad8efd8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:13.686075 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:13.687131 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:13.688044 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:13.688044 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:13.688044 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:13.688044 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 225/454] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:13.688345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.719288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.719925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.720202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.720470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.722724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.728236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.729679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:13.740613 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:13.741705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:13.743768 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 230/455] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:13.747445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.790637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e2b-866c-479e-b3ec-f1e95987c30c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.823047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.823574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.823870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.824137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.824762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.825082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.826442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.838034 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 226/456] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.838866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.846056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5bec3-cdf7-4c90-be57-32cda01495a0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.870301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.881993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.882586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.882863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.883128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.884444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:13.884742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.886157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.897944 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 231/457] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:13.898716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:13.932132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:13.939175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97a52c-c75a-4243-a86f-d322794de6ff None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:13.973241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:13.973852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:13.974126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:13.974397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:13.985310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:13.986742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:13.999751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6362-156b-4b2b-b462-d3523b0518ac None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:14.001617 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:14.002535 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:14.003390 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:14.003390 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:14.003390 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:14.003390 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 227/458] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:14.003624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.034602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.035185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.035458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.035724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.036378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.036672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.038017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.049867 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 232/459] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.050649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.094082 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.104013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de50c1-29d5-4848-b0cb-e047703cd2ff None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.136787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.137484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.137827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.138102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.138849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.139154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.140655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.157076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00be5b-4483-4c85-9b6c-854b94d4d741 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.157465 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 228/460] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.158269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.161580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.198728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.199397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.199675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.199970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.207524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.208995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:14.220370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:14.221465 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 233/461] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:14.222371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.264903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8cea-458c-4efe-9812-152990692be4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.298089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.298684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.298944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.299210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.299956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=08d6104d22ff4bb1bd295d99ca3c5ac3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.300258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.301692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.308164 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 229/462] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/role_assignments?user.id=08d6104d22ff4bb1bd295d99ca3c5ac3&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.308930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.322018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1edd-c9dd-45ed-adf7-93943f1a1f06 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.323760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.361476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.362139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.362268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.362537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.363191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.363492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.364952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.383001 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 234/463] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.383001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.396419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.439388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e8ed-eab5-4e01-851d-e2d63ff023e1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.481219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.481945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.482328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.482691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.490021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.491538 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.494133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aff86-e522-4885-9764-f3596f3ba320 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:14.503802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:14.504910 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 230/464] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:14.506306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.534617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.535218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.535490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.535759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.567430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.611671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.613422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.615195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0963d0-7d3c-4322-983f-cf3c8f2f5b19 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.643056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.654557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.656072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.656360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.656639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.657386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.657697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.659147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.687996 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 231/465] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.687996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.727598 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 235/466] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:14.728698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.791225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.800238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2527-ed3d-43a5-8c0d-b512dcb1db02 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.832399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a343e5-82b1-4697-a0ce-cb49c772bdc7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.838427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.839155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.839526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.840322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.848817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.850643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:14.865831 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:14.866919 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:14.868764 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:14.869644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:14.870300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.870631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.870952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.871705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:14.872006 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 232/467] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:14.872151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:14.873165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.873767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:14.886340 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 236/468] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:14.887233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:14.922219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:14.982166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885640cb-938c-473b-9dd7-e2e042aeb939 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:14.995307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79855be-d2a4-4e8f-af3b-ac8aafe29423 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.018496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.018664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.019237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.019520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.019785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.032783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.033652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.033981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.034244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.051343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.053714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:15.079047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:15.080150 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:15.081146 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:15.081146 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:15.081146 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:15.084153 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 237/469] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:15.085118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.116149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.117610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.165267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.197432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6692-a023-4662-8833-836df7f76729 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.227364 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 233/470] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:15.228669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.241211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818994e4-3217-439a-97fd-909432647547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.241918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818994e4-3217-439a-97fd-909432647547 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.242193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818994e4-3217-439a-97fd-909432647547 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.244111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818994e4-3217-439a-97fd-909432647547 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.245179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818994e4-3217-439a-97fd-909432647547 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:15.245487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818994e4-3217-439a-97fd-909432647547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.247095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818994e4-3217-439a-97fd-909432647547 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.274247 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 238/471] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:15.274247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818994e4-3217-439a-97fd-909432647547 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.310735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.341092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345be6a-ce02-40fc-9b4f-e7a5a9ad64e6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.375788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.376386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.376661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.376927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/d005fde5a49a456ab4769be3af172dd1/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.386209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818994e4-3217-439a-97fd-909432647547 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.391553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=d005fde5a49a456ab4769be3af172dd1, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.393025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.396650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.418401 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 234/472] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:15 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/d005fde5a49a456ab4769be3af172dd1/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:15.418401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.432684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.434140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.434793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.435202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.436222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:15.436650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.438384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.455077 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 239/473] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:15.456165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.574143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b64e-5a03-449b-99d3-bf8460c5ba2d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.575100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.592037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799258c-011b-449c-b8f9-8ed7a1e1c898 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.630934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.631606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.633233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.633233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.636190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.636799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.637075 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.637339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.653012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.654525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:15.671522 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:15.672676 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:15.674034 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:15.674034 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:15.674034 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:15.674034 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 235/474] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:15.674034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.716489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.718328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.729543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.786790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5bc3f-5aa3-4a8a-9eb7-f4a6ef77702c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.813734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.824237 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 240/475] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:15.825463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.825571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.826092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.826388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.826636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.834024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.835602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:15.849609 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:15.850720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:15.852043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:15.856017 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 236/476] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:15.856710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:15.934161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812077-4971-4fce-b160-c0c660333c5e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.970111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:15.970765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc5a5-e370-4a46-83f7-7f76f2088dba None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:15.971279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:15.971758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:15.972252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:15.973130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:15.973633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:15.975456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:15.981249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:15.988807 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 241/477] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:15.990019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.009983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.010583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.010861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.011126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.023054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.025262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:16.041286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:16.042282 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:16.043737 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:16.043737 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:16.043737 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:16.043737 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 237/478] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:16.043737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.051768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.103348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c1e-60a9-4b00-8aaf-49b01f349b49 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.139118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.139752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.140159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.140525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.141379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:16.141798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.143477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.161669 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 242/479] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:16.161669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.166286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c124b7-f239-4eb9-b883-073462c877f8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.207276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.208316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.208778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.209183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.217421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.219168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:16.232299 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:16.233350 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:16.234395 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:16.236665 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 238/480] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:16.237576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.264094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.274353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b04cb-70c7-480d-bbb5-de1f0fbc18a7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.288394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.312472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.313250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.313605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.314047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.314830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:16.315212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.318210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.331760 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 243/481] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:16.332846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.360829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20cc0-67c3-468d-9f14-1d0e17428c2b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.403066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.404049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.404466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.404964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.405920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=6b298c229b7f402c9883e743c82110a8) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:16.406453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.408177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.423617 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 239/482] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/role_assignments?user.id=6b298c229b7f402c9883e743c82110a8&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:16.423617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.499362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55060-eb99-4869-91a5-9f12e0007cb0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.572948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.573979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.574456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.576209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.577176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:16.583625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.585480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e4f99-395c-434b-9b97-3f6aeb49da38 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.600654 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 244/483] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:16.602720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d8f2e-fab6-441c-a387-5c7ea4c29a6f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.603200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d8f2e-fab6-441c-a387-5c7ea4c29a6f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.603534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.604326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d8f2e-fab6-441c-a387-5c7ea4c29a6f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.605956 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 245/484] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:16.607005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d8f2e-fab6-441c-a387-5c7ea4c29a6f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.628149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caba9a-0102-4a0b-aa8d-b3408bdda935 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.647041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.669880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.670504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.670781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.671048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.679503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.681510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7c760bdc-7969-4ea2-978f-ce767d568bd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:16.693642 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:16.694518 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:16.695433 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 240/485] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:16.697527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.697527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.697527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.717997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:16.719208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:16.747109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d8f2e-fab6-441c-a387-5c7ea4c29a6f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:16.789316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:16.791032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:16.791272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:16.791538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:16.792308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=8f4e1ab258e946cb935116e6c71bbd91) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:16.792606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:16.793538 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 241/486] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:16.794131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:16.794398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:16.810480 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 246/487] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/role_assignments?user.id=8f4e1ab258e946cb935116e6c71bbd91&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:16.922244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:16.964494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d97a7-c63e-481e-aaf5-e0a4243b0b34 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:17.018616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:17.019279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.019565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.019838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.020565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:17.020868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:17.023235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:17.039027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 242/488] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:17.046148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:17.154820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:17.160918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803795-3165-46a6-9bf4-27bfe1837ba4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:17.197622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:17.201870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:17.202485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.202757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.203024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.203753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=8b209bd7afbd44ceabe2d9b71e7585e7) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:17.204084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:17.205538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:17.213583 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 247/489] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:17 2022] GET /identity/v3/role_assignments?user.id=8b209bd7afbd44ceabe2d9b71e7585e7&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:17.358122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd18d5-2ca3-4724-9b5a-68ef3b46d8eb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:17.403548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:17.404892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.405316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.405921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.408376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:17.425894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:17.434653 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:17.435767 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:17.436802 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:17.439108 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 243/490] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:17.444935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:17.562790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc56a-832b-472c-9eee-898a307310d1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:17.601790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:17.603955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.604238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.604510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.605218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:17.605518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:17.607091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3366-ab78-4d48-a2f5-483f615cd4e9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:17.620885 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 248/491] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:17.626672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:17.729447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f73d1-63ac-4cfa-bfae-f0c4a5d342cd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.729762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f73d1-63ac-4cfa-bfae-f0c4a5d342cd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.729996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f73d1-63ac-4cfa-bfae-f0c4a5d342cd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.731458 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 249/492] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:17.736834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.737133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.737396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.756331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6a1ff-12c2-49b3-9280-87f51aabe8a5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:17.768029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:17.769343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:17.807869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:17.809093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:17.809757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:17.810036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:17.810306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:17.832178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:17.833643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:17.862179 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:17.863148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:17.864634 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:17.864634 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:17.864634 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:17.868785 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 244/493] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:17.870251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:17.924898 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 250/494] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:17.950769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:18.026608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870f4a-9f89-420d-9b63-0c9ce4d8d3ef None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.077419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.078029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.078302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.078568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.079200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:18.079494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:18.080883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:18.098958 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 245/495] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:18.105114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.220560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c4e8-e345-4e77-8d91-fd2d03b07389 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.265525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.266512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.266992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.267455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.279048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:18.280766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:18.295994 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:18.296922 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:18.297841 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:18.300533 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 251/496] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:18.306584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.322137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.349616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:18.487187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b3f4-283e-4284-8203-8a3f31f20a2e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.497919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:18.508416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d2ca1-775d-4612-93ff-4e03614dc71c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.545266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.545977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.546257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.546524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.547256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:18.547556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:18.549025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:18.584875 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 246/497] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:18.585512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.586140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.587877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.587877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.592896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.622115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:18.628035 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:18.628919 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:18.629758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:18.638044 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 252/498] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:18.644154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.751184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31434-70de-4d08-b9a5-651a489adf3a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.790660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:18.824218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcce39-1c63-4abb-9f2f-b9f4e3845382 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:18.832093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.832736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.833015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.833387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.854180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:18.855654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:18.861579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:18.862395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:18.862669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:18.862933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:18.863612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:18.864019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:18.865847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:18.875652 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 253/499] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:18.881571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:18.896425 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:18.897414 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:18.899285 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:18.899285 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:18.899285 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:18.899285 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 247/500] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:18.906072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:18.949583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.015415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9fe3-a3aa-4358-ae40-e7a135e01701 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.057881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.058593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.059128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.059407 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.065765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6294f8-cc75-40e6-b999-66ecc25fda7e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.073370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.075376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.088232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-20054c06-9648-489e-a2ff-3aa309ec0da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:19.094780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:19.096374 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 254/501] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd7ac-152a-4201-8f88-7807df047a3e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.098188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd7ac-152a-4201-8f88-7807df047a3e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.098954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd7ac-152a-4201-8f88-7807df047a3e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.104000 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 255/502] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:19.106150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.106608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.107149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.109974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.110696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.110976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.111242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.112469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:19.112469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.113578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.126895 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 248/503] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:19.127570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.131370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:19.132884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:19.220152 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 256/504] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:19.221103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.222193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.261999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb5078-64a5-4aa4-a038-7f2027e5962d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.304301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.305410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.305897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.306641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.308474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:19.309000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.310579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.325220 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 249/505] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:19.331055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.401817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f7147-0cae-4526-a013-b34a851e415f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.420475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.447295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.448266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.449818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.450297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.465421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.467144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:19.494093 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:19.495148 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:19.500804 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 257/506] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:19.503189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.516272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e657d0-0e22-40a8-a438-0114c9042775 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.566833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.568470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.568742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.569023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.575610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.585007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.587917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:19.605007 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:19.606043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 250/507] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:19.607577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.664498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23304-61bf-4519-b8fe-511130014af4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.703193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.704064 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.704514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.704927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.705779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:19.706133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.707584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.720719 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 258/508] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:19.721527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.728682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985ada-6698-45e8-9a77-abd6fff92629 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.761481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.764383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.765030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.765305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.765571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.777372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.779122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b4233004-3542-490f-b606-f09418e6f61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:19.798363 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:19.799352 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:19.800279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:19.800279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:19.800279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:19.805884 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 251/509] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:19.806924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c2d9-e022-42bd-a2c0-033180d04614 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.807422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c2d9-e022-42bd-a2c0-033180d04614 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.807546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c2d9-e022-42bd-a2c0-033180d04614 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.808791 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 252/510] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:19.809447 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c2d9-e022-42bd-a2c0-033180d04614 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.835737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b42d5-b872-4fac-b1dc-92a36bd211c9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.863549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:19.872631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.873216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.873486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.873751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.874467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:19.874762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.876199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.893998 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 259/511] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:19.894814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:19.925300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c2d9-e022-42bd-a2c0-033180d04614 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:19.960902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:19.962440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.962440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.962696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:19.964660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=08d6104d22ff4bb1bd295d99ca3c5ac3, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:19.966236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b572425-2f93-4567-ab7c-a50fca1d059b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:19.987897 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 253/512] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:19 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:19.987897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:19.987897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:19.987897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.004023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:20.005260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:20.013609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.022023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cdd6-bea2-4d65-ad29-eb48e0d7cf7b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.064694 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.065395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.065682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.066010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.066909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:20.067217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.069708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.092708 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 260/513] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:20.093615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.097042 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 254/514] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:20.097969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.159318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.243739 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc10da4-596f-48df-834a-7207ffac9ab9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.263549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e6cbb-cd7b-4539-a258-f2c64fb4d32a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.296769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.297646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.297924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.298440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.299502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.301565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1d34-0f63-4f0f-ac55-16fac3950c22 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.307910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.308510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.308779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.309048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.332650 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 255/515] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:20 2022] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:20.334384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c594c-5b57-4541-8650-85e313c66344 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.334673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c594c-5b57-4541-8650-85e313c66344 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.334978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c594c-5b57-4541-8650-85e313c66344 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.336921 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 256/516] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:20.342498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.344827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.345452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.345956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.369169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:20.370790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:20.394753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.396278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.452372 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 257/517] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:20.453646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.512696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.577054 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 261/518] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:20.585326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.631778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72365f-a79d-4a8f-9eca-25e6f7bb0690 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.655504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.669404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.670040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.670316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.670585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] PATH_INFO: `/v3/services/network` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.671171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.672571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:20.686783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:20.687803 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:20.688709 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 258/519] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:20.694036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.708634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f037e5-2516-41f7-be95-fc1caf39ef7f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.756882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.757529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.757807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.758596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.776951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.779241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:20.796324 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:20.797370 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:20.798250 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:20.798250 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:20.798250 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:20.800354 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 262/520] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:20.801285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.821294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.828564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1803-17cf-4af6-a1c9-d9f89211cfac None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.871639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.872347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.872868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.873247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.874315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] RBAC: Adding query filter params (name=network) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:20.874791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.876775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.883165 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 259/521] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:20.884559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:20.924094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791097d2-f013-496b-9e18-decd01a5ef45 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:20.934553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:20.970276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:20.971276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:20.971805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:20.972291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:20.973057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:20.975953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:20.989499 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:20.990515 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:20.991328 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:21.000249 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 263/522] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:21.000249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.017956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc746e0-a4b1-4782-ba5d-cd599cdd8345 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.057349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.058483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.058960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.059530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.060452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.060961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.062763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.079300 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 260/523] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:21.080683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.099259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:21.124176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3817a-83e0-466c-9862-2e94fafac8ed None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.163985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.165100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.165381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.165651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.166274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] RBAC: Adding query filter params (type=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.166573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.167947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.173820 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 264/524] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:21.174603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.200429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5513628-64b4-49bb-a1ba-0b018292e576 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.216870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:21.247315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.248427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.248950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.249469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.250502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.251016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.252818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.259419 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 261/525] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:21.265313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.308847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1e26-f93e-4606-907b-5e79eb3e4c6f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.353251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.353882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.354156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.354420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.364841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.366392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:21.379797 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:21.380774 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:21.381753 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 265/526] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:21.386184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:21.387538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.424372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ce9a1-90ce-4553-b095-f446cbfdc2aa None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.467005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.467724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.467997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.468262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.468897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.469197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.470631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.478237 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 262/527] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:21.515321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:21.523164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2f26-9059-4963-a3a0-11db71c85bef None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.565986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.566940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.567392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.567841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.568742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.569226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.572137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02361be-229b-48ba-ad4e-39c0f8f2a4a2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.587075 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 266/528] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:21.593827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:21.720162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eb05-dffe-4a33-87a9-096a77eedd08 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:21.758196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:21.760141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:21.760561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:21.760979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:21.761848 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=d005fde5a49a456ab4769be3af172dd1) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:21.762324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:21.763907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613f6e2-8b7e-4cec-bfd4-8d2e34161a13 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:21.770513 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 263/529] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:21 2022] GET /identity/v3/role_assignments?user.id=d005fde5a49a456ab4769be3af172dd1&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:22.670406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4987f-e5f4-4cd0-8e0c-5aaa7dced791 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.671284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4987f-e5f4-4cd0-8e0c-5aaa7dced791 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.671697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4987f-e5f4-4cd0-8e0c-5aaa7dced791 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.673440 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 267/530] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:22.678620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736fd4-25ec-4346-a9bf-7fb50bf974f3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.678914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736fd4-25ec-4346-a9bf-7fb50bf974f3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.679193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736fd4-25ec-4346-a9bf-7fb50bf974f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.691729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:22.708330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8f736fd4-25ec-4346-a9bf-7fb50bf974f3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:22.709542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8f736fd4-25ec-4346-a9bf-7fb50bf974f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:22.806007 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 264/531] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:22.892371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11134-66e4-419b-8e9d-17b4dcacb1ef None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.892561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11134-66e4-419b-8e9d-17b4dcacb1ef None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.892899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11134-66e4-419b-8e9d-17b4dcacb1ef None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.894384 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 268/532] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:22.899502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.899794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.900107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.923863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:22.925072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:23.001152 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 265/533] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:23.205215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb11134-66e4-419b-8e9d-17b4dcacb1ef None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.331501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb11134-66e4-419b-8e9d-17b4dcacb1ef None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.333276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.369453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.370076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.370357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.370631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.381485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:23.386605 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:23.387529 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:23.388396 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 269/534] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:23.395920 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.440207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:23.442614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:23.491960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ee472-df65-4b72-b4a7-778227f3c43d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.525432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.526224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.526511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.526789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.538648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:23.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:23.545720 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:23.546553 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 266/535] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:23.555109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.587571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89e8-cbfc-465d-b4e7-25e36d12135b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.645840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.646446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.646720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.646984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.647646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:23.647981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:23.650587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:23.662165 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 270/536] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:23.668657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.744518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00db7cc-f7a6-4c5e-93af-719f3b552c03 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.794455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:23.798218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:23.822409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.823063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.823276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.823526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.824210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:23.824506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:23.825878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:23.837824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023879-251b-4606-a02b-da2d93d196c8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.840940 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 267/537] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:23.846421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.877645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.878269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.878545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.878806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.900552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:23.902018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:23.928181 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:23.929207 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:23.930712 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:23.930712 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:23.930712 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:23.932914 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 271/538] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:23.937911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.058055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096331-f0be-4bbd-a074-b37a717a9b4c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.096968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.097589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.097865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.098130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.109048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745879ff-6ff7-4cd4-a42c-75735ce33c1e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.109884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.111524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-26eef40c-4767-46fa-8a56-7a302e68dbed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:24.127408 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:24.129703 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 268/539] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52813bab-db5b-4419-938b-741f159d3680 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52813bab-db5b-4419-938b-741f159d3680 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.131870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52813bab-db5b-4419-938b-741f159d3680 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.132800 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 269/540] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:24.140818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52813bab-db5b-4419-938b-741f159d3680 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.142587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.151319 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.152050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.152395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.152737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.153447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:24.153816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.155331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5fb51-3053-44d0-a85c-2d009f852c63 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.172143 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 272/541] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:24.173561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.173945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.174291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.191078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.194287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:24.196268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:24.267397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52813bab-db5b-4419-938b-741f159d3680 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.279877 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 273/542] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:24.279877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.330369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.330888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.331165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.331432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.332095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:24.332395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.333758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde637b5-e4a0-4c75-bd23-730770d8b777 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.347499 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 270/543] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:24.349000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd956ed2-cc9f-45a9-b5be-7ba5609a9deb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.349217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd956ed2-cc9f-45a9-b5be-7ba5609a9deb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.349480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd956ed2-cc9f-45a9-b5be-7ba5609a9deb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.351093 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 271/544] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:24.356978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd956ed2-cc9f-45a9-b5be-7ba5609a9deb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.382009 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d18d3-2275-4ad6-b639-485696efb95f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.400253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.418728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.419657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.420186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.420662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.428189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.429779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-306b0e65-3e47-4f32-9ac7-2964643576f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:24.444493 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:24.445550 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:24.447204 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 274/545] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:24.451690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.452069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.452421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.471393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:24.473037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:24.475461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.476351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd956ed2-cc9f-45a9-b5be-7ba5609a9deb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.518163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.519189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.519745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.520225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.529099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.530929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.551876 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 275/546] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:24.552062 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:24.552941 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:24.553875 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:24.554399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.557722 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 272/547] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:24.562935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.667525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db922e-7254-4c8b-a154-03a1b93167cc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.678385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.712053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716c986-de1a-49b6-9c63-b0f4b57c2a15 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.715913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.716522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.716795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.717064 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.717786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:24.718142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.719616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.746930 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 276/548] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:24.746930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.751300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.751927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.752206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.752473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.753245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:24.753543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.755398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c867-f1f3-43d2-98d2-36c898bb5638 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.775715 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 273/549] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:24.777351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5586ad-63df-49f3-ba3b-7a997382a9d8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.777642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5586ad-63df-49f3-ba3b-7a997382a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.777916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5586ad-63df-49f3-ba3b-7a997382a9d8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.782710 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 274/550] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:24.782710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5586ad-63df-49f3-ba3b-7a997382a9d8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.798754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:24.865196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb3e8-9357-4f22-bd3d-6d972ce73754 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.888225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5586ad-63df-49f3-ba3b-7a997382a9d8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.901921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.902515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.902792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.903059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.903698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.905100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.920724 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 277/551] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:24 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:24.921620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.929132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.929750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.930560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.930885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.957892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.015436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.016972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.033774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.048928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e0da-b7e0-4a9a-9a97-0a0e2fca087e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.089754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.089754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.090065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.090303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.103339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.104828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-04e160d9-18d0-4627-a757-039feea8a3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:25.121679 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:25.122665 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:25.123562 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:25.123562 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:25.123562 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:25.123562 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 278/552] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:25.125442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.125859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.126134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.130930 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 275/553] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:25.135967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.146080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:25.147584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:25.223387 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 279/554] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:25 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:25.224275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.240764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705cb2-5efc-4e80-b5ff-884f45deb9f9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.241439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.259651 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.284168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.285228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.285768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.286267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.287294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.289031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.313618 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 276/555] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:25 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:25.315128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.354964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f9f7-8163-4c39-9ab5-9fd491528dfd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.451405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.452805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.454177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.456401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.457468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:25.459508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.464192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.489609 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 280/556] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:25.492307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c128a-93ce-4531-8e37-d8402d708fdc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.496042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.551005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.551671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.551976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.552247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.565305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.566796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.569233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:25.585365 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:25.587053 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:25.588030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:25.588030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:25.588030 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:25.588030 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 277/557] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:25.588322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.620364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.634890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc0eb-cea2-43d4-9811-34003f54a04c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.675406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.676597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.677898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.678321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.687041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.688992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:25.704806 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:25.705897 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:25.706995 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:25.709354 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 281/558] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:25.710460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.714160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7693bb-5f9f-4c02-a989-41dc5a75383e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.755734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942619-01d3-4551-9692-2515047cea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.756584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942619-01d3-4551-9692-2515047cea5a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.756956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942619-01d3-4551-9692-2515047cea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.757387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942619-01d3-4551-9692-2515047cea5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.772657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54942619-01d3-4551-9692-2515047cea5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-54942619-01d3-4551-9692-2515047cea5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:25.781834 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:25.782997 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:25.784004 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:25.787936 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 278/559] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:25.788937 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942619-01d3-4551-9692-2515047cea5a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.842508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69871-8a1e-4727-a7da-d2069f489a25 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.870057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.882435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.883079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.884024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.884356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.885001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:25.885323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.886666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.887310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:25.903908 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 282/560] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:25.903908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:25.913498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942619-01d3-4551-9692-2515047cea5a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:25.949980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:25.950759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:25.951127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:25.951491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:25.952476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:25.952695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:25.954234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:25.970841 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 279/561] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:25.971550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.025744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce4a7-216f-4054-9c6d-a4d6d1c79462 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.070954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.071741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.071915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.072254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.072919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:26.073218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.074844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.081724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660154e5-3885-4ff5-8954-388880db58d6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.085735 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 283/562] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:26.087314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.121243 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.122052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.122451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.122809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.130527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.132115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.141438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:26.146166 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:26.152799 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:26.153741 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:26.157064 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 280/563] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:26.158441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.163708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:26.206357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2c0b-dbc9-47f7-9630-1f2ef6c56c5c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.247501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.248565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.248565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.248753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/29f0d08a13734a538a1f64d55c530829/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.265547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=29f0d08a13734a538a1f64d55c530829, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.266970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.279164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2d2cb-a6d5-4d14-9713-14d77fab1725 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.288022 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 284/564] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:26 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/29f0d08a13734a538a1f64d55c530829/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:26.289043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.340259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.341445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.341929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.342441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.365749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.367790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:26.396610 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:26.397619 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:26.399096 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:26.399096 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:26.399096 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:26.408363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:26.411146 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 281/565] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:26.416257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd65e9-748a-43fe-b174-408b1ffce31b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.418263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.459495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.460132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.460417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.460676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.461623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:26.462008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.463413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.478807 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 285/566] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:26.485398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.543240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:26.635091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27721f-eafb-486d-bda1-1ad4dcf891b8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.673361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.674474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.674965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.675431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.676300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:26.676817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.678531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.692598 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 282/567] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:26.699455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.725298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef6348-a43d-4f2f-85b6-3633fa4c1b82 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.774452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.775747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.776272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.776735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.777664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=08d6104d22ff4bb1bd295d99ca3c5ac3) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:26.778247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.779901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.788307 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 286/568] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/role_assignments?user.id=08d6104d22ff4bb1bd295d99ca3c5ac3&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:26.893739 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c247-7d82-4b02-b14c-dc34a3bfd83e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.920533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:26.946254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.946901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.947179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.947449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.960603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.962954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:26.978858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:26.979936 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:26.981017 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 283/569] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:26.985926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:27.023431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:27.127866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52b45-e370-4871-bdec-fceeecaa533f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:27.194709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:27.195255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.195618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.199884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.199884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:27.199884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:27.199884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfda77-d8ac-40c2-93e0-f34e46ff5f5a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:27.244518 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 287/570] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:27.250262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:27.348228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb180f-4b5f-42c9-8dbc-680e59db3b89 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.348557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb180f-4b5f-42c9-8dbc-680e59db3b89 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.348779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb180f-4b5f-42c9-8dbc-680e59db3b89 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.350829 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 288/571] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:27.360013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.360305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.360582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.382579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:27.385152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:27.441047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c59e9a-183a-4602-acc7-a62c73f10b63 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:27.487564 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 289/572] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:27.499146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:27.500091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.500583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.501068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.513061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:27.514772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:27.529837 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:27.530855 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:27.531726 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:27.531726 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:27.531726 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:27.533786 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 284/573] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:27.540940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:27.556228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:27.699981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4be1f-75d7-4cc5-b86c-5f6088399973 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:27.734613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:27.735208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.735484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.735750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.736414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:27.736711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:27.738131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756163f-5ec9-40f3-b825-c7a5df6a35bd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:27.750056 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 290/574] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:27.755663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:27.812918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:27.911384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bdb4-775f-480f-ab29-ac8368b7ee95 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:27.916538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db291d1-6865-4440-8d80-3e7110c32dda None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.916831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db291d1-6865-4440-8d80-3e7110c32dda None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.917105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db291d1-6865-4440-8d80-3e7110c32dda None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.918436 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 291/575] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:27.925118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.925400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.925669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.945304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:27.947159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:27.952565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:27.953197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:27.953473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:27.953737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:27.963581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:27.965068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:27.977773 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:27.978732 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:27.979623 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 285/576] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:27.980182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.030701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.043904 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 292/577] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:28.045011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.083431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.098705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89335993-491d-40b1-9352-f6ad9ff269b8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.139484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.140142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.140417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.140784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] PATH_INFO: `/v3/services/network` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.141359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.142735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:28.152500 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:28.153618 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.154493 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 286/578] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:27 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:28.159357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.218845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280d7aa-7444-4745-a5ff-f2e4011e3564 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.261646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.262247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.262523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.263244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.263960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:28.264266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.265801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.279999 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 293/579] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:28.286150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.353556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57268b0-4489-4cba-9067-e09efcbedf2e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.393873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.394476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.394748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.395014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.395634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] RBAC: Adding query filter params (name=network) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:28.396073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.397629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.402908 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 287/580] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:28.403710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.410233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.426002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.455670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c377-0132-4282-b64b-2bf496918cce None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.496378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.498231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.498231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.498231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/d005fde5a49a456ab4769be3af172dd1/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.499368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=d005fde5a49a456ab4769be3af172dd1, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.500844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.521152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2b60-e370-4a8f-93ca-8cda3d77d76f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.522493 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 294/581] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:28 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/d005fde5a49a456ab4769be3af172dd1/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:27:28.523444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.612765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.613338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.616161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.616161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.616161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.628551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:28.637444 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:28.638810 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:28.639979 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:28.642393 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 288/582] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:28.647937 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.721207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911978a8-7c1e-4409-b8b4-151b2b05085c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.740870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.761328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.761940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.762217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.762488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.763716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:28.764081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.765452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.776198 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 295/583] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:28.778493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.792348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:28.821641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed167-e0e8-4942-9c34-45053034221b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:28.902089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:28.902682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:28.902976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:28.903245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:28.903899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:28.904208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:28.905595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:28.910669 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 289/584] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:28.916858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:28.959700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf380-698b-433b-af0e-6512384740c6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.010234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.010851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.011128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.011399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.012140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] RBAC: Adding query filter params (interface=public, service_id=cd8b6d9d74b54038a2f57700678903ad, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:29.012444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.013866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab4dbf-e1ef-46d9-bf93-e1af3535bffe None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.027122 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 296/585] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/endpoints?service_id=cd8b6d9d74b54038a2f57700678903ad&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:29.029129 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f52fd-f43f-41e5-9127-9b31851104fb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.029417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f52fd-f43f-41e5-9127-9b31851104fb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.029718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f52fd-f43f-41e5-9127-9b31851104fb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.031166 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 297/586] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:29.031790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f52fd-f43f-41e5-9127-9b31851104fb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.065236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f3f3-e09b-4cb9-8334-e3e7c1fcccf7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.098061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.111698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.113325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.113819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.114556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.115663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:29.116671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.119398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337eb4-6668-4c1c-be27-020d1477e828 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.127504 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 290/587] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:29.129101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203859-d822-4bfc-baed-3607961d9170 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.129638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203859-d822-4bfc-baed-3607961d9170 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.130146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203859-d822-4bfc-baed-3607961d9170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.155399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-93203859-d822-4bfc-baed-3607961d9170 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:29.156625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-93203859-d822-4bfc-baed-3607961d9170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:29.158976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.172471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f52fd-f43f-41e5-9127-9b31851104fb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.213628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.214373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.214754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.215179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.215809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.217494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.223297 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 298/588] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:29.224273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.236264 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 291/589] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:29.383203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e8bd-5c90-48d0-88c6-ad79a0fa3a96 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.394851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.422140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.422686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.422963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.423231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.424004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] RBAC: Adding query filter params (interface=public, service_id=3c3b4c0f28dc4c858ee7565dcd1ce6f8, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:29.424313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.425755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9d99-4243-4a60-ae13-7f4b9326449c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.433016 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 299/590] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/endpoints?service_id=3c3b4c0f28dc4c858ee7565dcd1ce6f8&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:29.438580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93203859-d822-4bfc-baed-3607961d9170 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.543684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5160e-051c-42b0-88dd-be99fe75f6d2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.544093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5160e-051c-42b0-88dd-be99fe75f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.544303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5160e-051c-42b0-88dd-be99fe75f6d2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.545631 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 300/591] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:29.551470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.551751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.552051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.573242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:29.574403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93203859-d822-4bfc-baed-3607961d9170 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.574520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:29.625137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.626181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.626676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.627153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.628120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.629996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.637282 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 292/592] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:29.664067 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 301/593] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:29.736343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.739728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.873449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e5d3-605f-4749-bd29-e5cb03cf58c9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.909856 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.910486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.910765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.911034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.922032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:29.926871 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:29.927792 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:29.928702 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 293/594] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:29.936376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.024469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.070895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f448f-d70f-454d-93d0-f61c38dfa3e8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.077943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.107863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.156070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701b94-93ff-4794-9bae-9c5e00fbe156 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.160614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.161244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.161527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.161801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.162476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.162777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.164281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.183429 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 302/595] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.184591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.194671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.195634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.196106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.196510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.197319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.199085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:30.209225 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:30.210385 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:30.211913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:30.214139 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 294/596] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:30.220409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.332060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcde5-f943-4b93-9f1a-4dd44d28d68c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.361749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.369330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371069c-5f89-4242-af1a-c8d4a3b27911 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.372528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.373374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.373909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.374407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.375240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.375749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.377362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.383610 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 295/597] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:30.392743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.467372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.468252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.468549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.468815 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.480557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.482119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:30.496788 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:30.497781 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:30.498659 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:30.498659 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:30.498659 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:30.502566 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 303/598] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:30.503845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.511594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4d0ae-031b-4afd-83ea-075294c9988b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.524013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.550001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.551003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.551557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.552100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.553006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.553529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.555232 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.560657 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 296/599] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.612756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331b26-acb1-46e4-b79c-4e18908097c8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.649833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.650448 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.650726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.650995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.651636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.651965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.653382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.670798 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 304/600] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.672288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.750404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.817708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959b0-35c5-48e7-ad54-b6dcb82d729c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.854020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.855137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.855624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.856155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.864751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.866446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-12126b87-0913-4dd3-9a65-48a3ee4b8584 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:30.878932 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:30.879931 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:30.880940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:30.884669 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 297/601] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:30.890231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.993802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:31.017605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120be5-fb10-468b-83b6-7a5909b7da3d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:31.053482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:31.054130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.054367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.054638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.055990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:31.056299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:31.057739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:31.063098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad1fd-7f38-46d3-9506-e308ddf033fb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.063377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad1fd-7f38-46d3-9506-e308ddf033fb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.063650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad1fd-7f38-46d3-9506-e308ddf033fb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.065452 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 298/602] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:31.070763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.071069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.071616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.080611 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 305/603] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:31.082521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:31.112802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:31.114729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:31.200171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf481c-f096-46b4-8794-4989866f9bb7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:31.243274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:31.243904 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.244221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.244495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.248445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:31.252673 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 299/604] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:31.342372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:31.344137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:31.474437 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 306/605] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:27:31.480730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:31.540800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:31.599240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4a6e3-c0fd-49f5-98cc-129351adce91 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:31.638172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:31.651469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:31.652146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.652422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.652694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.674831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:31.676811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:31.693706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:31.708884 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:31.709937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:31.710858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:31.710858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:31.710858 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:31.715569 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 300/606] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:31.728959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:31.791950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79755c71-f2ee-4827-9c8d-a103cba42184 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:31.853238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:31.853868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:31.854147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:31.854420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:31.865408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:31.870782 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:31.871783 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:31.876772 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 307/607] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:31.877999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:31.932031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:31.949801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6f8-1364-41de-b402-96b6d13b955e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:31.984698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e27d1-41d7-4055-8497-caf58a331296 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.009932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.016115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.016731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.017009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.017279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.017919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:32.018335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.020843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.031947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.032561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.032841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.033116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.036236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:32.036546 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.037924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.046384 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 301/608] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:32.053774 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 308/609] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:32.060038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.060432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.174605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e39-0b13-4caa-aa5c-8847cd7abd3f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.223698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.224357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.224671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.225323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.243156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.244727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:32.272962 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:32.274047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:32.274936 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:32.274936 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:32.274936 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:32.274936 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 309/610] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:32.280794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.296789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14d57f-662c-4265-8dea-e76d15dc3929 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.310406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.342853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.343867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.344350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.344847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.352403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.354078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-aeb4dacf-dbd7-431f-a884-29f6e6135371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:32.366523 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:32.368006 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:32.368937 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:32.371035 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 302/611] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:32.372407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aaede-d744-4365-81c3-052a41df16d6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.372824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aaede-d744-4365-81c3-052a41df16d6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.373296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aaede-d744-4365-81c3-052a41df16d6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.374933 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 303/612] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:32.376523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aaede-d744-4365-81c3-052a41df16d6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.397416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.420856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02329b-3e88-415c-b865-8ce059136009 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.456325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.456886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.457186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.457444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.458088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:32.458410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.459873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0e080-40fa-4f1b-b685-fc0d73a2b2e0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.478608 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 310/613] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:32.480201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.480491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.480768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.500711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aaede-d744-4365-81c3-052a41df16d6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.500892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:32.502033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:32.545985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.547470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.547995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.548881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.550239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:32.550888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.552933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.570832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.572557 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 304/614] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:32.573673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.584193 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 311/615] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:32.585078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.681174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.713318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af64a09-a201-4d0a-8f7c-c6ca6c31eeb5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.726374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666d39-92f4-459c-8068-4d0d3ef59d60 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:32.760771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.762195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.762767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.763223 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.770279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:32.770952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.771302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.771647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.772782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.772912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=29f0d08a13734a538a1f64d55c530829) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:32.773238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:32.774759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.775213 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a40364-7ee8-4f00-8d31-1cb8cf7188d6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:32.782683 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 312/616] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/role_assignments?user.id=29f0d08a13734a538a1f64d55c530829&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:32.784269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc41ad-3f0e-4a95-8a64-09d596b43110 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.784624 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc41ad-3f0e-4a95-8a64-09d596b43110 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.784965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc41ad-3f0e-4a95-8a64-09d596b43110 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:32.789646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:32.790644 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:27:32.791611 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:32.792432 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 313/617] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:32.793673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:32.794024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:32.794387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:32.794882 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 305/618] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:32.803790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.837058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:32.838454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:32.946607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:32.964059 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 314/619] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:32.965013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:32.971873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e178f-df0d-41c9-8303-99278ecc00d7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.016835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.017851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.018338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.019492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.020508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:33.021468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.024747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.028699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.052452 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 306/620] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:33.059505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.100241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04290c19-4b0b-4286-b3f5-2935a19f7698 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.143785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.144443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.144720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.144990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] PATH_INFO: `/v3/services/network` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.145632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.147257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ccd36a84-2c41-492e-9128-19d70fab9a85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:33.156738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:33.158011 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:27:33.159073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:33.161905 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 315/621] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:32 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:33.163166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207890c-a427-429f-9057-063fb17f8843 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.163499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207890c-a427-429f-9057-063fb17f8843 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.163830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207890c-a427-429f-9057-063fb17f8843 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.169376 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 316/622] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:33.170256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207890c-a427-429f-9057-063fb17f8843 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.185019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f119d-383c-454d-b9c1-69ebc073e148 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.221501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.222203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.222558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.222836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.241427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.291933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.298170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207890c-a427-429f-9057-063fb17f8843 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.301007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.301870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.336982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.337834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.338286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.338720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.339499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] RBAC: Adding query filter params (name=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:33.339988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.341500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115686b-cdf8-4423-aae0-3bc73b1b71cd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.346383 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 317/623] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:33.347871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.348205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.348483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.367495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:33.368723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:33.417508 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 307/624] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:27:33.418371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.454401 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 318/625] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:33.455507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.527222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.532746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.538638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ce5e-f60e-447c-bb70-9de2bec556c2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.588399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.589612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.590110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.590580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.590865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d269d6-e2bc-4f5e-8535-23c4b48cac84 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.591589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.594392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:33.606553 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:33.607586 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:27:33.608504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:33.615875 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 308/626] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:33.617230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.639231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.639839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.640144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.640416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.641232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] RBAC: Adding query filter params (type=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:33.641355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.642768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.652497 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 319/627] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:33.652497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.754593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c5ccc-f9d2-4892-bbe5-939eb45a6ea0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.763699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f2ff-afd4-4161-ad8b-487511728c41 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.780041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.792886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.793494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.793772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.794042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.798910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.799507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.799783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.800078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.800699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:33.800998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.802641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.805934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.807392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.812793 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 320/628] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:33.812793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:33.827783 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:33.828903 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:33.829798 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:33.829798 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:33.829798 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:33.829798 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 309/629] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:33.829798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:33.842918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:33.925480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85aa8-266e-4f61-b0b8-3240e78a4990 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.936486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2493-843e-4ad5-84b7-df4bbfbc9814 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:33.961722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.962318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.962596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.962888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.963522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.964916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.975925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:33.976949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.977270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.977525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.978272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:33.979751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:33.991999 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 321/630] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:33.993477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.015894 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 310/631] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:33 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:34.015894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.082497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.142571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.221610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8c261-9cbc-42cc-a200-2d083bb8a435 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.257689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d7849-a7eb-4c29-afb0-177683243b2e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.274796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.275414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.275691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.276045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.276694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:34.276995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.278378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.295977 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 311/632] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:34.298256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.308363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.309304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.310379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.310865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.311700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:34.312751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.315044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.322955 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 322/633] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Oct 19 00:27:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:34.329512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.414923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd73ff-0d9a-4866-be8f-705a6ca40629 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.447322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.457772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.458346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.458459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.458668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.458939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.466848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28a7d-70fa-4125-91c5-08dc46742e95 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.468448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.469909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:34.484917 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:34.485870 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:34.486782 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:34.491976 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 312/634] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:34.495070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.511382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.512405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.513237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.513693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.514777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.516512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.544547 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 323/635] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:34.637893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941a811-5d82-4950-ba46-ea0cae440e82 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.684975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.685523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.685799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.686066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.686770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:34.687076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.688595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f673-deae-4a03-b60d-346d9ddb16c9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.702840 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 313/636] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:34.709377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.823523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29f3b0-7d2b-4bde-beb0-ca301022369f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.859667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.860374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.860651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.860921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.861658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=d005fde5a49a456ab4769be3af172dd1) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:34.861960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.863394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d6b0-6ce5-4ce5-bb6c-2fb32731204d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.870119 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 324/637] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:34 2022] GET /identity/v3/role_assignments?user.id=d005fde5a49a456ab4769be3af172dd1&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:35.250844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca8d6-b8fa-40d5-9ced-b665d7645277 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.251251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca8d6-b8fa-40d5-9ced-b665d7645277 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.251432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca8d6-b8fa-40d5-9ced-b665d7645277 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.253125 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 314/638] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:35.259178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.259682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.259763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.278370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:35.279558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:35.291124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:35.352412 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 325/639] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:35.622583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca8d6-b8fa-40d5-9ced-b665d7645277 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:35.670738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:35.731120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca8d6-b8fa-40d5-9ced-b665d7645277 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:35.765853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:35.766868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.767344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.767813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.779563 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:35.784781 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:35.785796 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:35.786646 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:35.790102 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 315/640] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:27:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:35.797929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:35.902582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2974fd7-bfd9-4522-ae76-2225dc3929d6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:35.941813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:35.942801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.943282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.943752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.944636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:35.945141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:35.946750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:35.955657 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 326/641] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Oct 19 00:27:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:35.963877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.063990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924bbf3-1a59-43b5-894d-f8ef9a4d007b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.065556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.100708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.101749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.102211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.102664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.113763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.115409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:36.130779 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:36.131730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:36.132813 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:36.132813 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:36.132813 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:36.135276 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 316/642] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:36.140691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.152756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.251363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737f8b-5233-42f5-b889-29c74a77bd53 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.286862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.287482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.287727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.288031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.288670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:36.289485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.290864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80007b-e705-4655-9b65-1cb9ca366e44 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.304100 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 327/643] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:36.313334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.425055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28471a-4bc4-402b-9da7-d60a5bd3a42a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.441152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca02c2-0589-49f5-9697-3be399678f6a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.441451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca02c2-0589-49f5-9697-3be399678f6a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.441707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca02c2-0589-49f5-9697-3be399678f6a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.443156 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 328/644] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:36.450195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.450483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.450756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.470516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:36.472065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:36.473600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.474226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.474501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.474771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.484193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.485649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:36.497253 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:36.498249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:36.499197 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:36.503076 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 317/645] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:36.503938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.520904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.548485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.555988 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 329/646] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:36 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:36.626471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882779fd-04fb-4330-bbdf-6945a23126a9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.662613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.663554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.664592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.665091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.666074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:36.666614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.668347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.687548 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 318/647] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:36.692852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.807933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafafe7-9073-4d28-852d-3ca54bd7350b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.843472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.844127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.844410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.844687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.845650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.856210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.857673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:36.873112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:36.874138 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:36.875023 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:36.875023 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:36.875023 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:36.875023 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 330/648] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:36.880956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.927886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.936404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.959127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10742-569d-4537-a611-c1d079fec7c6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.993811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.994441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.994721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.994996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.995576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.996987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.997890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20810-48c9-44b2-9d29-b241a4907b9c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-06c257c8-66d3-4e31-9d1a-89635e129d74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:37.005730 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:37.006863 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:37.008455 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 319/649] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:37.009453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3365-dbdf-49ea-9b38-7eb3f5e5d872 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.009453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3365-dbdf-49ea-9b38-7eb3f5e5d872 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.009453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3365-dbdf-49ea-9b38-7eb3f5e5d872 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.010619 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 320/650] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:37.013241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3365-dbdf-49ea-9b38-7eb3f5e5d872 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.045664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.046679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.047252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.047730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.048572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.049077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.050634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dcd18-d051-4465-a2cb-968d7a1ab97c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.067716 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 331/651] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:37.069324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.070878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.071359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.093949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:37.095188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:37.128120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3365-dbdf-49ea-9b38-7eb3f5e5d872 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.166744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.167348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.167625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.167919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.168549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.168854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.170230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.170743 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 332/652] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:37 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:37.171743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.177066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.182719 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 321/653] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:37.190268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.224193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.286128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82229-c2d7-417a-b238-01683667daf7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.299476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8585-4396-4d96-a0af-3dab3e193663 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.322212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.322833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.323110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.323381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.330031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.331469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.336289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.337073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.337500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.337973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.338735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.339198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.340729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbcf3f-b1bf-43c2-ad8f-7317697d70ef None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8787fcdf-3526-46a7-b91f-f60d8eb418a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:37.342859 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:37.343735 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:37.344688 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 333/654] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:37.345525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b13be-bf60-4edc-bb6d-ce4a119b4c88 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.345525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b13be-bf60-4edc-bb6d-ce4a119b4c88 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.345657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b13be-bf60-4edc-bb6d-ce4a119b4c88 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.346986 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 334/655] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:37.349722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b13be-bf60-4edc-bb6d-ce4a119b4c88 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.353248 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 322/656] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:37.354896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.355501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.356104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.375240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:37.376450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:37.443826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.452998 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 323/657] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:37 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:37.453767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.456595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.460814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b13be-bf60-4edc-bb6d-ce4a119b4c88 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.502757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.503268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.503540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.503811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.504522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.504823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.506243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.522342 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 335/658] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:37.522342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.566038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2e46a-45d6-48ec-8b1c-48e01853dc5c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.601154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.602812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.603098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.603655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.604409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] RBAC: Adding query filter params (interface=public, service_id=91205e0995784c7ca150ca510a9023de, region_id=RegionOne) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.604720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.606093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.615955 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 324/659] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/endpoints?service_id=91205e0995784c7ca150ca510a9023de&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:37.616862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.629059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4438-2a2c-478a-b5e2-6a6c0ff3db67 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.667490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.668280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.668563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.668837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.669412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.670896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.680137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:37.682073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:37.683140 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:37.684407 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 336/660] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:37.685254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.711610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.730438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072833c-adcc-4665-a53b-70b93ba11db4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.764610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.765189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.765529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.765814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/29f0d08a13734a538a1f64d55c530829/roles/9bd8bea910b641d5b798a9c959eb0474` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.767997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=29f0d08a13734a538a1f64d55c530829, role_id=9bd8bea910b641d5b798a9c959eb0474)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.769717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.782616 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 325/661] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:37 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/29f0d08a13734a538a1f64d55c530829/roles/9bd8bea910b641d5b798a9c959eb0474 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:37.783575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.788425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38274dd-4b57-4e35-bb10-5890bca0594a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.829469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.830649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.830953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.831229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.831844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.833664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.840791 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 337/662] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services => generated 1029 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:27:37.841672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.932632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fdf8-ec86-49a9-90df-368e200d2db1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.959424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.962028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.977548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21bab-df68-4541-a910-ebf55c7e249a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.988948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.989936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.990448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.991307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.992332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.993125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.994582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:38.004029 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 326/663] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:38.009671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:38.023152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:38.023795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.024248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.024623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.025229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:38.026816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:38.037647 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:38.038733 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:38.044630 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 338/664] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:38.045799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:38.140755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a8826-d6bb-4857-bce4-a083bef75d8d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:38.179216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:38.180674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.181129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.181549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.182322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:38.182787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:38.182913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cf5c-c3bc-43bc-8210-0b454e34df35 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:38.184479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:38.189710 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 327/665] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:38.226205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:38.227682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.228150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.228564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.229424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:38.229900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:38.231672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5246ae-47e6-4875-aac4-d0149a468b74 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:38.237618 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 339/666] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:38.247062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:38.306503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:38.375102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def336b1-e16a-49bc-98a6-a33d5ae0ca73 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:38.411552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:38.412545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.413042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.413511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.414503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:38.415004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:38.416639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea21b5-7ce3-4827-b0e9-5f88d8742cee None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:38.427998 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 328/667] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:40.041654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2abe68-79f3-4950-b071-039443e0ad5c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.042170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2abe68-79f3-4950-b071-039443e0ad5c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.042279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2abe68-79f3-4950-b071-039443e0ad5c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.043753 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 340/668] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:40.049486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab994e8-7de4-4dca-8ec0-15d7513f82c5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.049984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab994e8-7de4-4dca-8ec0-15d7513f82c5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.050062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab994e8-7de4-4dca-8ec0-15d7513f82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.070603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2ab994e8-7de4-4dca-8ec0-15d7513f82c5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:40.071833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2ab994e8-7de4-4dca-8ec0-15d7513f82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:40.143474 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 329/669] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:40 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:40.173428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393685a-f94c-432f-b045-90514bdf15ff None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.173734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393685a-f94c-432f-b045-90514bdf15ff None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.173988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393685a-f94c-432f-b045-90514bdf15ff None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.175584 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 341/670] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:40.181326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.181614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.181890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.201150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:40.202326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:40.243709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:40.279253 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 330/671] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:40 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:40.421966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393685a-f94c-432f-b045-90514bdf15ff None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.441507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:40.533614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393685a-f94c-432f-b045-90514bdf15ff None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:40.562148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.569372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:40.570023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.570462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.570807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.581837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:40.587454 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:40.588462 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:40.589302 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 342/672] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:40.594678 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.681103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea410fc-23d0-49c9-aed7-137ea7500bd6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:40.682769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:40.708742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185b1b-4a0f-4556-9d27-e88a7f2ebdd9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:40.720982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:40.721859 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.722138 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.722409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.722984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:40.724402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c472d736-e2cb-426b-a932-eae21d1bee85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:40.734177 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:40.735958 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:40.736913 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 331/673] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:40.737714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d9c4-38b5-4960-a8bf-354efdf95244 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.737714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d9c4-38b5-4960-a8bf-354efdf95244 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.737714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d9c4-38b5-4960-a8bf-354efdf95244 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.738463 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 332/674] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:40.743781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3d9c4-38b5-4960-a8bf-354efdf95244 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.752658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:40.753261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.753537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.753802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.754454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:40.754749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:40.756129 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d7cc-7730-4123-ac83-c875d34c315e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:40.766129 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 343/675] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:40.768031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588026d9-120b-4023-b82b-df804d160c5b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.768691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588026d9-120b-4023-b82b-df804d160c5b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.769271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588026d9-120b-4023-b82b-df804d160c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.782249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:40.790600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-588026d9-120b-4023-b82b-df804d160c5b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:40.792200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-588026d9-120b-4023-b82b-df804d160c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:40.850676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3d9c4-38b5-4960-a8bf-354efdf95244 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:40.860530 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 344/676] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:40 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:40.861347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588026d9-120b-4023-b82b-df804d160c5b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.892988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:40.893665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.894009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.894366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.894996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:40.895291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:40.896680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e9004-9d89-4df7-a744-ebeca506f1c9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:40.907146 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 333/677] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:40.907146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017f64-e03a-4488-84aa-65cf767d391f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:40.907146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017f64-e03a-4488-84aa-65cf767d391f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:40.907146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017f64-e03a-4488-84aa-65cf767d391f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:40.907146 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 334/678] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:40.908155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017f64-e03a-4488-84aa-65cf767d391f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:40.944736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:40.980095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588026d9-120b-4023-b82b-df804d160c5b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.017236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:41.019080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.019706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.020015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.020310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.024517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017f64-e03a-4488-84aa-65cf767d391f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.031918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.033384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-231e667e-8135-4945-bd83-2605265db5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:41.049403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:41.050839 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:41.051787 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:41.051787 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:41.051787 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:41.051787 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 345/679] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:41.051787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.052093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.052619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.064819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.065998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.066419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.066822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.067580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:41.068180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.069669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.070371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:41.071566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:41.075633 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 335/680] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:41.076690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.147284 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 346/681] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:41 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:41.148197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.190908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25bd3-206b-464f-bea5-b652c3b24513 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.198729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:41.228559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.229350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.229625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.229892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.230578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:41.230879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.232306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.250069 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 336/682] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:41.250069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.256099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e94b7-a8b3-439c-ae16-c02228714e8c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.271496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:41.293045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.293912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.294376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.295130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.296617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.298574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.336356 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 347/683] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:41.336356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.363842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c264c3-a4fd-45b7-be85-87cf9bf2753b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.409499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.410166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.410452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.410723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.411443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.412885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.429932 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 337/684] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:41 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:41.431372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.479231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1647f-d4ce-45dc-8ebb-05e8ae65a570 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.490516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:41.547308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.549001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.549304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.550005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.560364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.563084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.576945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:41.581040 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:41.582087 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:27:41.583272 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:41.588961 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 348/685] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:27:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:41.589946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.620892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57c5a-5c45-4de9-8762-d38a242b3057 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.667789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.668599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.668881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.669147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.669802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.671172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.686873 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 338/686] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:41 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:41.717784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a553b-5542-42e6-a5a0-77c1901ad54e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.771637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.772211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.772555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.772834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.774059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:41.774498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:41.776128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:41.798643 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 349/687] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Oct 19 00:27:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:41.804921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:41.917286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e0585-8db9-426b-b00f-f24c5cc61888 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:41.953336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:41.953945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.954224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.954493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.964530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.029257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.030726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.141638 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 339/688] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:27:42.146916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.167723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.265291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698c3da-97e0-40b6-b6f7-69b9db7926a5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.301205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.301759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.302036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.302307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.313692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.315143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:42.330966 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:42.332034 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:42.332965 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:42.332965 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:42.332965 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:42.332965 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 350/689] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:42.338735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.381504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.443182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ce309-3d3e-4fbe-b99c-4c91e8531b12 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.482325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.482940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.483220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.483491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.484162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:42.484462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.485832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.497707 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 340/690] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:42.503248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.573197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.608935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787de989-7c1b-4548-807a-5abe1ec1f36e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.643683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.644346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.644663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.644941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.651958 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.653459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:42.665595 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:42.666473 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:42.667773 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 351/691] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:42.672794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.778111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.782091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e4714-944c-4f32-8997-9373b4f207f2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.817818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.818425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.818703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.818973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.819659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:42.819988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.822054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a583ea-7aa5-4c1d-9ad0-0577f770afcb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.839256 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 341/692] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:42.844865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.948867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b064a3-fc65-45c2-a504-e39ffdf598d7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.981969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.984941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.985673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.985856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.986077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.986808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] RBAC: Adding query filter params (role.id=9bd8bea910b641d5b798a9c959eb0474, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=29f0d08a13734a538a1f64d55c530829) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:42.987132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.988724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ca7cc-190f-4b74-b355-a03b0e307baa None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.995547 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 352/693] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/role_assignments?user.id=29f0d08a13734a538a1f64d55c530829&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=9bd8bea910b641d5b798a9c959eb0474 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:43.671156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413645d2-bdaa-4f4a-b715-f3c13120a9fa None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:43.672187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413645d2-bdaa-4f4a-b715-f3c13120a9fa None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:43.672694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413645d2-bdaa-4f4a-b715-f3c13120a9fa None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:43.674721 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 342/694] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:43.681532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffd5a-aee4-4c60-85a9-a413c8b414fb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:43.682502 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffd5a-aee4-4c60-85a9-a413c8b414fb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:43.682994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffd5a-aee4-4c60-85a9-a413c8b414fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:43.703060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-414ffd5a-aee4-4c60-85a9-a413c8b414fb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:43.704679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-414ffd5a-aee4-4c60-85a9-a413c8b414fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:43.783954 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 353/695] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:43.801528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3535bd-32ff-4f22-aa67-af9ef8e8d071 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:43.802138 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3535bd-32ff-4f22-aa67-af9ef8e8d071 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:43.802605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3535bd-32ff-4f22-aa67-af9ef8e8d071 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:43.804512 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 343/696] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:43.813204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ef2c-ffd1-44a7-a12c-9f1002fa3422 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:43.813721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ef2c-ffd1-44a7-a12c-9f1002fa3422 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:43.814187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ef2c-ffd1-44a7-a12c-9f1002fa3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:43.833245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1359ef2c-ffd1-44a7-a12c-9f1002fa3422 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:43.834823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1359ef2c-ffd1-44a7-a12c-9f1002fa3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:43.908125 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 354/697] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:44.018377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a382-35b1-4b72-8e73-79a191c7338e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.018727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a382-35b1-4b72-8e73-79a191c7338e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.018929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a382-35b1-4b72-8e73-79a191c7338e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.020585 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 344/698] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:44.025827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.026118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.026391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.045876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:44.047053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:44.058746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a382-35b1-4b72-8e73-79a191c7338e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.106842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.135964 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 355/699] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:44.187969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.192363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a382-35b1-4b72-8e73-79a191c7338e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.230271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.230823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.231103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.231374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.232035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.233521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:44.243930 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:44.245204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:44.246804 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 345/700] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:44.251213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.279161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.301997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1080e-6ffc-43de-84f9-53e78995d1eb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.338601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.339617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.340148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.340621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.341397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.343025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:44.353218 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:44.354228 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:44.355073 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.357840 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 356/701] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:44.363632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.363911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567615d2-baf3-4fb4-8c3d-b5e77b8c0e36 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.403064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.403672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.403998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.404274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.404949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.405251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.406777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.422033 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 346/702] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:44.423773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.424117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.483477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651c80-1e82-41ec-95ac-c7c390e05758 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.513023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.521929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.522531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.522814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.523085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.523943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.524306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.525679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.529111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c827-c21c-4bbb-a293-5e2cbd8d3d1e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.535019 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 357/703] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:44.535825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.564033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.564632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.564909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.565181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.565801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.566101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.567462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.572729 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 347/704] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:44.573501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.672612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4d769-0bd1-4066-9c9f-4f3fa6197f33 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.687913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.717501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.717760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904257a-589f-4b0a-a352-9af5bce7e546 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.718180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.718396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.718670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.719260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.720815 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:44.732101 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:44.733200 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:44.734122 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:44.738464 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 358/705] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:44.739917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.771581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.774390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.774636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.775181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.775831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.776156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.779461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.793700 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 348/706] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:44.800189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.828253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.877004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d6c39-c8ab-48a2-bb01-9069d7b59230 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.923227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.923992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.924384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.924653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.925285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.925636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.926950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.928119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d25e5-2bde-4adc-82e7-b1fe91ca85ad None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:44.933891 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 359/707] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:44.939283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:44.969879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:44.970884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:44.971402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:44.971945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:44.972898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] RBAC: Adding query filter params (interface=public, service_id=98fabfaf91dc4852a023373ceb23c0d1, region_id=RegionOne) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:44.973426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:44.975304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:44.986405 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 349/708] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/endpoints?service_id=98fabfaf91dc4852a023373ceb23c0d1&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:44.986766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:44.988330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:45.056822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c086e-0bed-4ba5-8448-5397678d8857 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.072947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:45.097194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93395-1148-4c17-9c09-66791c1c030d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.097863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.098788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.099427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.100215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.101045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:45.101668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.103239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.114455 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 360/709] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:45.117623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:45.143188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.143803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.144114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.144385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.145010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.146440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16b5b-d7c5-4efc-aaec-6d55506da2e0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.160170 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 350/710] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:44 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:27:45.245514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8838d4f-f3cb-40af-acec-573483b1faa9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.247240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:45.252681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729a41-cdfe-4610-a067-4531209ae421 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.253012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729a41-cdfe-4610-a067-4531209ae421 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.253252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729a41-cdfe-4610-a067-4531209ae421 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.254946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 351/711] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:45.260730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.261017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.261289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.281182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:45.282434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:45.284394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.285012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.285290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.286459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.286459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] RBAC: Adding query filter params (interface=public, service_id=1708fd222f7e4b5cb159ef1d21d381f3, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:45.286649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.288025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.295203 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 361/712] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:45 2022] GET /identity/v3/endpoints?service_id=1708fd222f7e4b5cb159ef1d21d381f3&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:45.301869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:45.373903 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 352/713] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:45.436373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45200f-9188-403a-8308-d43a8b1ace9d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.472873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.473484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.473761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.474035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.474649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.476927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.487970 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 362/714] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:45 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:27:45.655815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:45.730539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:45.763319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc80fb-2e7d-4857-b81b-2d93fa1a80e6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.799173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.800196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.800691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.801165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] PATH_INFO: `/v3/services/image` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.801948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.803556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:45.813279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:45.814379 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:45.815249 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:45.817968 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 353/715] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Oct 19 00:27:45 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:45.824305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:45.857769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:45.931401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0013-cf2d-4504-9f57-b36058c80a8e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:45.967405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:45.968528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:45.969027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:45.969495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:45.970328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] RBAC: Adding query filter params (name=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:45.970829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:45.972436 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeecd36-fd90-48e0-a662-72f17d19e986 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:45.978835 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 363/716] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:45.984192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:46.092093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1abd14-2d39-48fd-9e41-3f86b88d3a55 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:46.130055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:46.130663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:46.130943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:46.131211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:46.131839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] RBAC: Adding query filter params (type=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:46.132165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:46.133627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67335b-a30f-4b02-8032-858f214fa4bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:46.136080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:46.139071 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 354/717] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:46.849506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ddeb4-125a-4e57-b29b-ded878ef6954 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:46.850264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ddeb4-125a-4e57-b29b-ded878ef6954 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:46.850377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ddeb4-125a-4e57-b29b-ded878ef6954 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:46.852599 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 364/718] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:46.858235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109ac8-3e01-448e-ba6e-ac0131911039 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:46.858696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109ac8-3e01-448e-ba6e-ac0131911039 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:46.858774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109ac8-3e01-448e-ba6e-ac0131911039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:46.877679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-86109ac8-3e01-448e-ba6e-ac0131911039 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:46.878798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-86109ac8-3e01-448e-ba6e-ac0131911039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:46.949590 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 355/719] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:47.218171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ddeb4-125a-4e57-b29b-ded878ef6954 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:47.322962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:47.332335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ddeb4-125a-4e57-b29b-ded878ef6954 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:47.369723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:47.370328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.370606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.370874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.371532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:47.373077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77821e14-435e-46a1-9382-6b3e6ebe8de2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:47.396127 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 365/720] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:47 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:47.416012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6ab7-6c98-4e65-a2ae-b76464cc246f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.416354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6ab7-6c98-4e65-a2ae-b76464cc246f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.416575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6ab7-6c98-4e65-a2ae-b76464cc246f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.418314 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 356/721] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:47.424254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f832e1-461a-432a-9c36-e77edbce032f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.424576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f832e1-461a-432a-9c36-e77edbce032f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.424809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f832e1-461a-432a-9c36-e77edbce032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.447317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-67f832e1-461a-432a-9c36-e77edbce032f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:47.448586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-67f832e1-461a-432a-9c36-e77edbce032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:47.535750 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 366/722] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:47.808361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6ab7-6c98-4e65-a2ae-b76464cc246f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:47.844726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98970-2ff0-4b1e-a299-ff78a85613ae None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.845404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98970-2ff0-4b1e-a299-ff78a85613ae None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.845770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98970-2ff0-4b1e-a299-ff78a85613ae None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.847208 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 367/723] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:47.853586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.854555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.855031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.875676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:47.877408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:47.918808 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6ab7-6c98-4e65-a2ae-b76464cc246f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:47.952147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:47.959135 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 368/724] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:47.968890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:47.970252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.970974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.971675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.972565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:47.974227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:47.985031 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:47.986043 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:27:47.986897 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:47.989768 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 357/725] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:47.996425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.017245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.108878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5325b7-85b5-4620-83d1-7835e5859e97 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.144877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.145483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.145761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.146080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.146715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.147022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.148965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.154410 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 369/726] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.160230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.275349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c623-6395-4197-9d1f-98dace7b710a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.291567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.317808 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.318968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.319762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.321172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.322045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.322721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.325108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.333439 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 358/727] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.339097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.377490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.403240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.407284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0847-3f28-4cb7-9e0c-c684cb52e35f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.446449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.447068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.447347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.447616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.448218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.448332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941c3a8-e829-4f35-878b-77a17c63ad45 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.449598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-17849aca-6de7-4dc0-b77c-0dbf5cfdb3f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:48.461512 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:48.462675 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:48.464112 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 370/728] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:48.464935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7bd-fa88-4783-824a-6467266a7f04 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.464935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7bd-fa88-4783-824a-6467266a7f04 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.464935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7bd-fa88-4783-824a-6467266a7f04 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.469759 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 371/729] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:48.470240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd7bd-fa88-4783-824a-6467266a7f04 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.489468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.490015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.490292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.490566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.491224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.492895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b816a-d55c-42ae-897e-8cbb5a9fc852 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.516881 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 359/730] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:48.518731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.519084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.519424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.548449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:48.550678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:48.603626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd7bd-fa88-4783-824a-6467266a7f04 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.648566 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 360/731] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:48.659137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.659757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.660063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.660333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.660984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.661281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.662672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.664639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.671622 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 372/732] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.676992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.729677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.790326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6b5c-ea9d-4384-9d17-c3605378dcdd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.826295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.826871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.827150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.827422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.828079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.828379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.829804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.835173 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 361/733] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.841385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.925535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.945062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465af148-5661-4a6f-b0d7-ed0b47876aba None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.986588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.987274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.987634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.987997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.988845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.990270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae1a3-637f-4868-9733-cf163162806b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.015891 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 373/734] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:49.056018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fb90a-2fd9-40c5-b3b9-1e2d6e39f2f7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.067679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.107440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.108569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.109067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.109553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.110524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.112272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6116ee-567d-4981-85c4-baa5628eb8db None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.140031 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 362/735] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:48 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:49.647993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416cd8b-6e45-41f1-9656-06aa37ea4418 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.649401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416cd8b-6e45-41f1-9656-06aa37ea4418 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.649914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416cd8b-6e45-41f1-9656-06aa37ea4418 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.651779 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 374/736] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:49.656773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.657058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.657334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.676240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:49.677425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:49.756212 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 363/737] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:49 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:50.025923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416cd8b-6e45-41f1-9656-06aa37ea4418 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.086903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.138713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416cd8b-6e45-41f1-9656-06aa37ea4418 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.173376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.174000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.174276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.174545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.175120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.176564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:50.187126 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:50.188169 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:50.189567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 375/738] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:50.194242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.286704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.296877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74b729-6c29-4b0d-8b17-d21280d104a7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.335335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.336545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.336836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.337301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.338413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:50.338927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.341666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.348900 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 364/739] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:50.356847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.481988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db806f5-b7da-46b3-a429-b99b72d490e7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.500614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.522613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.523627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.524152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.524454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.525098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:50.525401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.526777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.532979 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 376/740] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:50.539840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.662978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860cec-3f50-4c04-970c-d5d155f15005 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.703116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.704157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.704606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.705045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.705764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] RBAC: Adding query filter params (interface=public, service_id=a4a9060aae714f7b86095c5e968ec2af, region_id=RegionOne) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:50.706070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.708170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182491e-9684-4515-bc75-2153e5ecddf9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.719588 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 365/741] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/endpoints?service_id=a4a9060aae714f7b86095c5e968ec2af&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:50.725606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.861338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810800da-f5a5-4925-afc7-ad0bd094df80 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.894065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83385c-5c27-4f41-942c-06f7c54146cf None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.894349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83385c-5c27-4f41-942c-06f7c54146cf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.895125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83385c-5c27-4f41-942c-06f7c54146cf None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.896865 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 366/742] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:50.902146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa975-41c6-4ec3-91cc-c41c3bb72fc9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.902521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa975-41c6-4ec3-91cc-c41c3bb72fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.902884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa975-41c6-4ec3-91cc-c41c3bb72fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.903741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.904595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.905053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.905500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.906581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.908342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.917333 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 377/743] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:27:50.925094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-417fa975-41c6-4ec3-91cc-c41c3bb72fc9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:50.927411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-417fa975-41c6-4ec3-91cc-c41c3bb72fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:50.949074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:51.021612 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 367/744] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:50 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:51.299225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:51.350637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:51.392896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55407-b491-4fe6-bb78-754efbe7ea38 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.393442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55407-b491-4fe6-bb78-754efbe7ea38 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.393442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55407-b491-4fe6-bb78-754efbe7ea38 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.394772 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 368/745] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:51.400669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b617-09a0-4d87-bbe3-9bb475a88131 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.401056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b617-09a0-4d87-bbe3-9bb475a88131 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.401227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b617-09a0-4d87-bbe3-9bb475a88131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.409104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be8f2-0bf6-43d6-9111-0972ab309cea None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:51.419805 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a4e6b617-09a0-4d87-bbe3-9bb475a88131 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:51.421029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a4e6b617-09a0-4d87-bbe3-9bb475a88131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:51.448584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:51.449189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.449471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.449746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.450388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:51.451823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:51.454585 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING keystone.server.flask.common [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 00:27:51.477373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:51.477373 dv-cinder-master-3-smb devstack@keystone.service[81723]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:51.477373 dv-cinder-master-3-smb devstack@keystone.service[81723]: [parameters: {'id': '8b638797a382400ea61b0c4105bdee26', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:27:51.477373 dv-cinder-master-3-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b638797a382400ea61b0c4105bdee26.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b638797a382400ea61b0c4105bdee26. Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:51.486024 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:27:51.488222 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Oct 19 00:27:51.489419 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:27:51.490326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:27:51.491213 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:51.492758 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'id': '8b638797a382400ea61b0c4105bdee26', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.497803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:51.499019 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b638797a382400ea61b0c4105bdee26. Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 378/746] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Oct 19 00:27:51 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:51.500621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:51.511007 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 369/747] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:51 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:51.595416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2821710-9359-42bb-9b2d-1dc331424496 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.595770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2821710-9359-42bb-9b2d-1dc331424496 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.596184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2821710-9359-42bb-9b2d-1dc331424496 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.597862 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 370/748] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:51.603331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.603702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.604097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.613993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f88c2-46c0-4460-8369-962aa0318a3f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:51.615671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:51.632212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:51.634394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:51.653937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:51.654567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.654957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.655227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.662778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:51.665108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:51.677617 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:51.678738 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:51.680337 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 379/749] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:51.685205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:51.721855 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 371/750] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:51 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:51.791308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:51.792620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5e41-921a-4e6d-ba19-38c82c1066ce None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:51.820827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:51.828967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:51.829582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.829857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.830127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.830917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:51.831220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:51.832829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:51.854296 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 380/751] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:51.905761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828867-27b0-454e-9c73-d0afbd904da2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:51.946891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:51.947587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.947877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.948172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.948765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:51.950162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:51.960032 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:51.961727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:51.962588 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:51.966509 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 372/752] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:51.968971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.002550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.023463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.101806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a04f-94f3-4e7f-b8b8-09e7d01574ae None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.107657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.144647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.145263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.145542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.145655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec39d-af30-43f4-9874-6d29c0621344 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.145814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.146445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.146751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.150563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.155383 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 381/753] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:52.161179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.193281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.194480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.195754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.196258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.197542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.199235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:52.212471 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:52.213504 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:52.214391 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:52.218131 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 373/754] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:52.227879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.269286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.287366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a5e3-e124-44a8-b4dc-a1321ee39884 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.333633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.335173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.335630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.336680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.337776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.338229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.340051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.347044 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 382/755] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:52.353180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.356484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f05f-d3f3-4482-adec-42a102cdd3e6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.395153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.395818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.396247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.396247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.396897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] RBAC: Adding query filter params (name=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.397236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.399108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.401317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.410618 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 374/756] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:52.416855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.529622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4273a-0b45-4b6b-9bc7-69ecc0b531be None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.573662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.574549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.574975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.575416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.576251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] RBAC: Adding query filter params (type=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.576717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.578308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.584552 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 375/757] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:52.592869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.633575 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7782c-0b1c-4be6-bb23-d6b91cf11b4e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.677902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.678423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.678699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.678969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.680221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] RBAC: Adding query filter params (interface=admin, service_id=1708fd222f7e4b5cb159ef1d21d381f3, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.680528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.681891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.687679 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 383/758] 10.222.0.33 () {56 vars in 1249 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/endpoints?service_id=1708fd222f7e4b5cb159ef1d21d381f3&interface=admin®ion_id=RegionOne => generated 193 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:52.688968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.697531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.715953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.736655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e19601-6920-4817-b80c-c2a0ca4c893a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.779192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.780507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.781037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.781511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.782662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] RBAC: Adding query filter params (interface=public, service_id=cf281cefe6ac4485b42e16141cd6c88f, region_id=RegionOne) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:52.783767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.785671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.798755 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 376/759] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/endpoints?service_id=cf281cefe6ac4485b42e16141cd6c88f&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:52.799359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.825112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0151-f650-4503-b6af-c48c3f9d0417 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.862472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.862874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.863148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.863408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.864035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.865386 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf9bf-e95a-46e0-8c51-a04311e28e9d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.880152 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 384/760] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:27:52.921850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1619e-05db-4cd2-b0c7-27b6c28c90b3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.952627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.960925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.961801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.962098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.962461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.963084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:52.964924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7172-c707-4194-84c4-92a298eb896e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:52.972602 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 377/761] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:27:53.266835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e96d-4012-41d5-a93f-9eca63812e87 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.267184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e96d-4012-41d5-a93f-9eca63812e87 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.267289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e96d-4012-41d5-a93f-9eca63812e87 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.269188 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 385/762] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:53.275486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.275771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.276072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.294787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:53.296002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:53.367767 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 378/763] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:53 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:53.641281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e96d-4012-41d5-a93f-9eca63812e87 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:53.725461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:53.749879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e96d-4012-41d5-a93f-9eca63812e87 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:53.784926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:53.785549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.785818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.786085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.786660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:53.788041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:53.798519 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:53.799885 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:27:53.800764 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:53.804756 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 386/764] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:53.808250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:53.912021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a8bc0-5c81-41e9-876c-e0590693d8e4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:53.938125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:53.952336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:53.952939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.953211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.953477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.954104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:53.954397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:53.955758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:53.966027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 379/765] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:53.967488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.070989 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22c5f-d11e-4643-928d-b1685c0b31cb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.110203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.110859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.111130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.111398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.112047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:54.112340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.113688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10cc37-8444-4e48-a3c5-c1a908b08306 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.123765 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 387/766] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:54.125161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.187044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232e9c-030b-439a-a572-97a37bb213c4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.187330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232e9c-030b-439a-a572-97a37bb213c4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.187487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232e9c-030b-439a-a572-97a37bb213c4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.189116 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 388/767] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:54.194273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.194557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.194827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.211473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.218307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:54.219833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:54.243428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f674db-983c-4c5e-89e9-d2e7ac8457e8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.280766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.281475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.281815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.282220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.282888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.284296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.306484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 389/768] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:54 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:54.313922 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 380/769] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:54.578111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.690768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a76a56-717e-44aa-abd1-de53493cae35 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.731786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.737312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.737914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.738184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.738848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.739196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.740704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.757334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:27:54.757334 dv-cinder-master-3-smb devstack@keystone.service[81723]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:27:54.757334 dv-cinder-master-3-smb devstack@keystone.service[81723]: [parameters: {'user_id': 'e996b67463864afaa31a59d3d53fcb8d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:27:54.757334 dv-cinder-master-3-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:54.765849 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:54.766732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:27:54.767695 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:27:54.768658 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:54.769578 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:54.770472 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e996b67463864afaa31a59d3d53fcb8d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:54.771320 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 19 00:27:54.774112 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:54.776558 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 390/770] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Oct 19 00:27:54 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:54.784273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.831241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.896191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7397-48ab-4195-8710-59262d4159c1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.934435 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.935071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.935344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.935672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.943878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.945349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-04eb9934-c06a-43ba-830b-24da963b0e20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:54.956912 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:54.957949 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:54.958902 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 381/771] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:54.966866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.080366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae76bc-3a46-4be5-94d3-2240f552ddcc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.116497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5794ef-2704-42b9-a811-36d46f67edc9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.116788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5794ef-2704-42b9-a811-36d46f67edc9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.117967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5794ef-2704-42b9-a811-36d46f67edc9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.120140 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 382/772] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:55.123643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.124387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.124837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.125198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.126034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:55.126184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f399-e540-4b51-ae24-893ed9fbe488 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.126464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f399-e540-4b51-ae24-893ed9fbe488 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.126616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.126715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f399-e540-4b51-ae24-893ed9fbe488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.128432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551600f-bea9-4ec9-a496-2fe7173e69b1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.145019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3097f399-e540-4b51-ae24-893ed9fbe488 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:55.146195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3097f399-e540-4b51-ae24-893ed9fbe488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:55.168266 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 391/773] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:55.237151 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 383/774] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:55 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:55.325163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b5e6-fc9f-43b2-9054-32e828998f1b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.325638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b5e6-fc9f-43b2-9054-32e828998f1b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.326045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b5e6-fc9f-43b2-9054-32e828998f1b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.327814 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 392/775] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:55.333769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.334196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.334573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.354701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:55.356098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:55.385796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.432964 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 384/776] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:55 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:55.515337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b5e6-fc9f-43b2-9054-32e828998f1b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.573289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.631146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b5e6-fc9f-43b2-9054-32e828998f1b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.666744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.667285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.667555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.667819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.668588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.669939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:55.678938 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:55.680053 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.680910 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 393/777] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:55.686024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.706189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.791413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5b08-f60c-4b47-8e6a-1201309bbd43 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.817073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533922-68bd-402b-a3c2-04571b5994e3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.828751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.829350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.829629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.829897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.830517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:55.830813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.832202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.837883 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 385/778] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:55.838610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.843639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.862055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.862672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.862943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.863208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] PATH_INFO: `/v3/services/image` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.863778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.865154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.870875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:55.874156 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:55.875926 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:55.876818 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 394/779] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:55.881826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.948306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7f93-61da-4b70-9460-4a6602111104 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.983376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.984261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.984379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.984554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.985180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:55.985474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.986836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.987373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188504be-93b3-4714-904f-8e2ebf2bc2db None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.991682 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 386/780] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:55.997177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.024610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.025302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.025481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.025747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.026371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] RBAC: Adding query filter params (name=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:56.026668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.028047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.033132 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 395/781] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:56.039417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.088996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.093330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.105130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce057c-39a6-4b2c-a2a4-469281e047f7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.139744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.140508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.140840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.141110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.141761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.143124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.151619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1399be-bb27-43c7-a23c-734bd7c3eb8c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.171879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 387/782] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:56.199042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.199562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.199832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.200126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.200755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] RBAC: Adding query filter params (type=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:56.201049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.202422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984db38f-d797-4e82-b9c7-1b60af766d19 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.208364 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 396/783] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:56.214577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.326784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1f36-61f4-4c28-9de4-b1a7c7c97070 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.367521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.368160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.368427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.368693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.369362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.370731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f5fd-93e5-4225-80d5-f2b1f5dee74e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.392027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 388/784] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:56.700042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a517-31a5-45d2-b144-bb2d0832dac1 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.700417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a517-31a5-45d2-b144-bb2d0832dac1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.700603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a517-31a5-45d2-b144-bb2d0832dac1 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.702086 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 397/785] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:56.707035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.707330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.707604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.720728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.728257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:56.730288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:56.805340 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 389/786] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:57.076998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763a517-31a5-45d2-b144-bb2d0832dac1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.182433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763a517-31a5-45d2-b144-bb2d0832dac1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.184775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.218016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.218633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.218910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.219180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.230226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:57.235032 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:57.236056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:27:57.236987 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:57.240162 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 398/787] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:57.242104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.350368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0599e-7bfe-4596-8f6a-3efa223f2bd7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.380344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.387125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.387728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.388032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.388303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.388970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:57.389272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.390634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.403713 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 390/788] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.405007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.509526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856c89-27fe-4214-bbea-38505058cc17 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.543387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.544035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.544315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.544584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.554515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.556169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:57.571277 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:57.572326 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:57.573282 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:57.573282 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:57.573282 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:57.573282 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 399/789] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:57.578023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.688685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de12a-0b6c-45b8-a33d-564926692cbe None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.722005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.722605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.722884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.723154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.723790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:57.724118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.725739 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.738687 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 391/790] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.744894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.763952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.847387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b8ff3-05da-4d4a-a671-dad33b4bedc7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.883595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.884169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.884458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.884718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.892283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.893712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:27:57.904753 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:57.905698 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:27:57.906668 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:57.908175 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 400/791] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:57.911539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.967142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.013487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c95883-f40e-4f15-b398-b025c51e90f0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.047830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.048462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.048740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.049009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.049734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.050036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.051463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.073686 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 392/792] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.075358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.156694 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.181325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331701ec-bb25-4412-bb3f-e0eee4e62a79 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.216051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.216674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.216974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.217246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.228576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.230010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d1c26b1f-d965-4e81-83d2-7e344505b69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:58.244497 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:58.245574 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:58.251439 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:58.251439 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:58.251439 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:58.251439 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 401/793] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:58.253098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.360513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33747b7-2198-4c27-8e06-fcb6392c828a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.374206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.394353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4c0f-4dcb-46be-93de-db2da092ee42 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.394721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4c0f-4dcb-46be-93de-db2da092ee42 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.394912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4c0f-4dcb-46be-93de-db2da092ee42 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.396415 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 402/794] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:58.397362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.397970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.398312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.398592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.399233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.399532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.400945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.401791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459380-fb9f-4a70-86f5-c06260905de8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.402078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459380-fb9f-4a70-86f5-c06260905de8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.402692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459380-fb9f-4a70-86f5-c06260905de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.413127 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 393/795] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.418731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.425198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-23459380-fb9f-4a70-86f5-c06260905de8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:58.426707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-23459380-fb9f-4a70-86f5-c06260905de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:58.508215 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 403/796] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:58.529032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcea46-03bc-49f2-b41a-7776a6fd10f1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.562579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.563203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.563478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.563747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.570421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.571936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.572994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9d8b-f971-4c8d-a2e6-1506dee4d1a0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.573285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9d8b-f971-4c8d-a2e6-1506dee4d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.573672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9d8b-f971-4c8d-a2e6-1506dee4d1a0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.575038 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 404/797] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:58.580260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.580543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.580816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:27:58.584886 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:58.586457 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:58.588167 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 394/798] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:58.592403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.603772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:58.605538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:58.629768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.672679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.691878 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 405/799] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:27:58.705541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2ecba-1ac5-41d5-bed1-5c21de4b80c9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.739153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.739759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.740067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.740339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.741023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.741324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.743411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.755303 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 395/800] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:58.761885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.774556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.868083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c65ff8-b040-4b9d-a270-8b5629c2ab42 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.870743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.880559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a60c3-811e-4d7e-9e66-fb47162d8197 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.902999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.903653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.903964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.904238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/9bd8bea910b641d5b798a9c959eb0474` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.906372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=08d6104d22ff4bb1bd295d99ca3c5ac3, role_id=9bd8bea910b641d5b798a9c959eb0474)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.907804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.918933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.919553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.919842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.920143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.921240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.921981 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 406/801] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:58 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/08d6104d22ff4bb1bd295d99ca3c5ac3/roles/9bd8bea910b641d5b798a9c959eb0474 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:58.922668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.924576 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 396/802] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:58.934087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.957943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.990971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:59.057932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a347-0399-4aad-8988-d40822715eee None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.072677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960113c4-37ae-4db8-b64e-917fbc00f443 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.102963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.103570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.103909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.104215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.104881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.106329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.113437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.114054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.114371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.114655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.115328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.116764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.125925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.sql.core [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:59.125925 dv-cinder-master-3-smb devstack@keystone.service[81722]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:59.125925 dv-cinder-master-3-smb devstack@keystone.service[81722]: [parameters: {'id': 'd8e948fed03e4e2a986635fd6c4b04ea', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:27:59.125925 dv-cinder-master-3-smb devstack@keystone.service[81722]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81722) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:27:59.136910 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 407/803] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:58 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:59.143064 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:27:59.144244 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application yield resource Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise self.value Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application session.commit() Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:27:59.149051 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:27:59.150024 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:27:59.151068 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:59.151976 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [parameters: {'id': 'd8e948fed03e4e2a986635fd6c4b04ea', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:27:59.153295 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:59.155161 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:27:59.157345 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 397/804] 10.222.0.33 () {60 vars in 1137 bytes} [Wed Oct 19 00:27:58 2022] POST /identity/v3/domains => generated 190 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:59.159010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:59.265895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:59.270002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244173-8e4b-4d3c-82fa-4d75d8ced178 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.310227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.310861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.311193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.311472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.323949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.325679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a371b15c-4b7c-43de-b657-c5bb4ab5f2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:59.340779 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:59.341805 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:59.342732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:59.342732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:59.342732 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:27:59.342732 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 408/805] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:59.348356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:59.376575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:59.456502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f0eee-7e8e-4e3b-95f5-35596d5db811 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.493286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.493900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.494180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.494450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.495117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:59.495420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.496813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0320e-9a22-4515-8f6f-b2a58fad5db3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.508667 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 398/806] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:01.084610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f00ab-21e0-4628-8cc0-fa4a23ac6d3f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.085169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f00ab-21e0-4628-8cc0-fa4a23ac6d3f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.085169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f00ab-21e0-4628-8cc0-fa4a23ac6d3f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.086518 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 409/807] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:01.091889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffacf-1a29-4e3d-9176-89211e6c2e73 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.092318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffacf-1a29-4e3d-9176-89211e6c2e73 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.092451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffacf-1a29-4e3d-9176-89211e6c2e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.111143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ac8ffacf-1a29-4e3d-9176-89211e6c2e73 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:01.112342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ac8ffacf-1a29-4e3d-9176-89211e6c2e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:01.176668 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 399/808] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:01.358077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db49af-01f2-48af-9d5e-7c87ebeff5a1 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.358269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db49af-01f2-48af-9d5e-7c87ebeff5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.358614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db49af-01f2-48af-9d5e-7c87ebeff5a1 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.359963 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 410/809] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:01.365313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.365666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.366003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.384342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:01.385496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:01.394420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.448509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db49af-01f2-48af-9d5e-7c87ebeff5a1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.451765 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 400/810] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:01.547040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db49af-01f2-48af-9d5e-7c87ebeff5a1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:01.580904 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:01.581519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.581792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.582057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.592060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:01.596801 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:01.597912 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:28:01.598775 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 411/811] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:01.604246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.701299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf086a-70cb-46bf-956a-7a1741217674 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:01.737015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:01.737618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.737897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.738166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.738820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:01.739123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:01.740218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.740609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:01.748987 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 401/812] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:01.754488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.756148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.762851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.843642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fc11-814b-4412-b918-81dcfce9d3e5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:01.853800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525931-78ae-4d49-936a-d3aa3d6a38ec None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:01.879198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:01.879747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.880085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.880359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.881443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:01.882952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:01.884439 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 412/813] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:01.886592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:01.887212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.887487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.887755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.890079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.898241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:01.899775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:01.915144 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:01.916311 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:01.917674 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:01.917674 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:01.917674 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:01.917674 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 402/814] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:01.921875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.970595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.978705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.990309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923d22-6b1b-452b-9304-a2253e6f7f58 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.020790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc488-d0a6-4e09-8aeb-146c4c6d1aa1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.024912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.025499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.025773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.026039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.026668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.028151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.049888 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 413/815] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:28:02.056248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.056868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.057149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.057436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.058072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:02.058372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.059787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.073664 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 403/816] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:02.079530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.187258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b664-e61e-4901-8ce3-3b99743d3959 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.222765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.223396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.223670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.223988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.227704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.233232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.235101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:02.247464 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:02.248683 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:28:02.250257 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 414/817] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:02.254553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.355544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0dbb-d0c6-4af2-96c6-52d301a92e5d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.373442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.390886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.391487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.391770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.392071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.392793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:02.393096 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.394528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.411105 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 404/818] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:02.416968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.516178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24378c-31e8-4bf3-b41b-d6832f02d05a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.549368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.549978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.550257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.550526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.611895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.620259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.621711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.716574 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 415/819] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:28:02.722268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.821220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d1d9-14d6-4260-bfe3-361ad5a86bc0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.855169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.855788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.856103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.856373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.866070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.867777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:02.883423 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:02.884592 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:02.885712 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:02.885712 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:02.885712 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:02.887993 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 405/820] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:02.890138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.983398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.990247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ad07-aa20-4c43-bb00-2a6aeea020d4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.024776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.025367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.025644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.025909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.026538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:03.026834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.028212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.039200 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 416/821] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:03.044799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:03.073485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:03.142536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1539e-02b7-45ad-a01b-80dc4827bfb1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.174093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.174696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.174972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.175239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.182321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.183749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:03.194689 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:03.196366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:03.197300 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 406/822] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:03.202053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:03.300643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad39a3-7755-4b0a-a159-49f564f3c337 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.333715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.334245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.334522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.334790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.335503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:03.335807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.337258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4521f1-141f-4ce9-bfc9-a9f100376f43 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.349100 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 417/823] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:03.355933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:03.441974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:03.454318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395afe9f-1f9e-418d-a02a-a251d08e8e02 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.487303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.487936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.488216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.488484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.489204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] RBAC: Adding query filter params (role.id=9bd8bea910b641d5b798a9c959eb0474, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=08d6104d22ff4bb1bd295d99ca3c5ac3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:03.489506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.490926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ed159-5a3e-47e8-9329-e61067e016d3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.496925 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 407/824] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:03 2022] GET /identity/v3/role_assignments?user.id=08d6104d22ff4bb1bd295d99ca3c5ac3&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=9bd8bea910b641d5b798a9c959eb0474 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:04.301658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4de7-7153-46d2-a4e8-39eea9d04d05 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.302190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4de7-7153-46d2-a4e8-39eea9d04d05 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.302190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4de7-7153-46d2-a4e8-39eea9d04d05 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.303513 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 418/825] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:04.309472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.309759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.310034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.329473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:04.330653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:04.396421 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 408/826] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:04.672725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4de7-7153-46d2-a4e8-39eea9d04d05 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:04.691367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:04.774515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4de7-7153-46d2-a4e8-39eea9d04d05 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:04.807602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:04.808224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.808497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.808763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.818533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:04.823517 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:04.824670 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:28:04.825588 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 419/827] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:04.830609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:04.909276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:04.927775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e8e3-4dcf-4851-ac02-9e538596effb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:04.961487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:04.962071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.962348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.962614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.963262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:04.963564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:04.964955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:04.972647 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 409/828] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:04.979358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.054260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.076862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42b66-4272-4f0c-9d10-3c327052f96d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.110003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.110602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.110877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.111145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] PATH_INFO: `/v3/users/e57ef8b0cd6b427a95f9d35127071568` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.125106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] RBAC: Authorizing `identity:get_user(user_id=e57ef8b0cd6b427a95f9d35127071568)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:05.126564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:05.128150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 420/829] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:04 2022] GET /identity/v3/users/e57ef8b0cd6b427a95f9d35127071568 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:05.133970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.231161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6d2f-9ede-4954-bd36-0607c5bb3800 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.264421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.265037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.265315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.265584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.266679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] RBAC: Authorizing `identity:get_project(project_id=a434698321db46838c9669058a22e1ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:05.268147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20776af0-433d-404a-9c87-9a43510c956d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:05.269751 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 410/830] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/projects/a434698321db46838c9669058a22e1ed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:05.275777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.371819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e857-25af-4106-bebf-7fc3256b77f7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.404339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.404978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.405254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.405526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed/users/e57ef8b0cd6b427a95f9d35127071568/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.407413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a434698321db46838c9669058a22e1ed, user_id=e57ef8b0cd6b427a95f9d35127071568, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:05.408862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447942-11e9-4598-9d85-0d7829e541ef None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:05.410954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.421470 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 421/831] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:05 2022] PUT /identity/v3/projects/a434698321db46838c9669058a22e1ed/users/e57ef8b0cd6b427a95f9d35127071568/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:07.541561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546ad0-526f-4179-b621-064b30b2c446 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:07.542100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546ad0-526f-4179-b621-064b30b2c446 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:07.542100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546ad0-526f-4179-b621-064b30b2c446 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:07.543470 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 411/832] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:07.548620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:07.549010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:07.549171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:07.566903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:07.568118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:07.634158 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 422/833] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:07.905572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546ad0-526f-4179-b621-064b30b2c446 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:07.921873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:08.006029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546ad0-526f-4179-b621-064b30b2c446 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.037864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.038995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.039383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.039654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.049827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:08.055279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:08.056468 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:08.057366 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 412/834] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:08.062370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:08.156733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42acd-0019-4784-9ffd-14900e79f0d0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.180115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:08.191557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.192176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.192452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.192722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.193371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:08.193671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:08.195137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:08.203096 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 423/835] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:08.208987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:08.280838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:08.310998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a0e4-0d64-487d-b7bb-12162dcb4755 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.343351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.343983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.344258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.344521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] PATH_INFO: `/v3/users/e57ef8b0cd6b427a95f9d35127071568` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.345603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] RBAC: Authorizing `identity:get_user(user_id=e57ef8b0cd6b427a95f9d35127071568)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:08.347015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:08.348582 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 413/836] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:08 2022] GET /identity/v3/users/e57ef8b0cd6b427a95f9d35127071568 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:08.354726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:08.450668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2584ad1-c16b-4f54-a323-9bfea3ceed70 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.482708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.483294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.483569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.483842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.535664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:08.549544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:08.550980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:08.645942 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 424/837] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:28:08.651889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:08.749463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6463-09e1-42ea-b143-813815c1865a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.781218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.781827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.782109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.782380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.783479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] RBAC: Authorizing `identity:get_project(project_id=a434698321db46838c9669058a22e1ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:08.784943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2544b-c116-4da9-a5ae-47c6e8ad394f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:08.786521 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 414/838] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:08 2022] GET /identity/v3/projects/a434698321db46838c9669058a22e1ed => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:08.793140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:08.876280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:08.890939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187299-81f1-4553-b6b7-c628bec7772a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:08.923642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:08.924245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.924518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.924781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.925489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=a434698321db46838c9669058a22e1ed, user.id=e57ef8b0cd6b427a95f9d35127071568) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:08.925786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:08.927206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c115-124d-410d-b023-75f4bc01bfff None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:08.933267 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 425/839] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:08 2022] GET /identity/v3/role_assignments?user.id=e57ef8b0cd6b427a95f9d35127071568&scope.project.id=a434698321db46838c9669058a22e1ed&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.057595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb23fb-a81d-4d81-a65a-3ab4b5543efa None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.058145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb23fb-a81d-4d81-a65a-3ab4b5543efa None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.058145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb23fb-a81d-4d81-a65a-3ab4b5543efa None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.059472 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 415/840] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:11.064644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.065049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.065193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.083266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:11.084478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:11.149104 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 426/841] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:28:11.419976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb23fb-a81d-4d81-a65a-3ab4b5543efa None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.431699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.519136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb23fb-a81d-4d81-a65a-3ab4b5543efa None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.551506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.552140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.552413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.552677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.553768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.555994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d3a34-24fc-416b-8ded-fdc9eec55c50 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.557527 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 416/842] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.563283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.641553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.660861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97ac5-2811-404f-b80b-518a1013f679 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.694589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.695117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.695496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.695771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.696437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.697865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737c16e-a1c9-4867-ad8e-72eb0d62b504 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.717988 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 427/843] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:13.906275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e1fa-6575-4357-8c2f-cac246faf29b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:13.906782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e1fa-6575-4357-8c2f-cac246faf29b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:13.906782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e1fa-6575-4357-8c2f-cac246faf29b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:13.908097 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 417/844] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:13.913113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:13.914170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:13.914170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:13.932790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:13.933962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:13.998762 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 428/845] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:14.269866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228e1fa-6575-4357-8c2f-cac246faf29b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:14.344860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:14.369162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228e1fa-6575-4357-8c2f-cac246faf29b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:14.401411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:14.402019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.402297 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.402565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] PATH_INFO: `/v3/roles/42aa243014164140995772918b521a86` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.403958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] RBAC: Authorizing `identity:get_role(role_id=42aa243014164140995772918b521a86)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:14.405333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:14.406628 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 418/846] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:14 2022] GET /identity/v3/roles/42aa243014164140995772918b521a86 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:14.412437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:14.477195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:14.512051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b371a23-75d0-4cb8-b7ff-cd4d896d7cc9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:14.545141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:14.545755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.546032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.546304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] PATH_INFO: `/v3/users/d166e918a92f42299a00779c51018e7c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.559253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] RBAC: Authorizing `identity:get_user(user_id=d166e918a92f42299a00779c51018e7c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:14.560723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:14.562313 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 429/847] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:14 2022] GET /identity/v3/users/d166e918a92f42299a00779c51018e7c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:14.568004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:14.667499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817faa8-54cc-4420-891d-954e2221c0e0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:14.699701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:14.700338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.700620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.700890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.701986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] RBAC: Authorizing `identity:get_project(project_id=a434698321db46838c9669058a22e1ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:14.703412 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ff7b8-7720-4ac3-bc45-1e25fd602a01 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:14.705055 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 419/848] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:14 2022] GET /identity/v3/projects/a434698321db46838c9669058a22e1ed => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:14.711592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:14.807423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896b60-0c77-496e-8f60-91f3cfabf441 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:14.830852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:14.842453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:14.843093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.843366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.843629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed/users/d166e918a92f42299a00779c51018e7c/roles/42aa243014164140995772918b521a86` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.845713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a434698321db46838c9669058a22e1ed, user_id=d166e918a92f42299a00779c51018e7c, role_id=42aa243014164140995772918b521a86)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:14.847145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2553-cf61-4ff3-b8be-358cddcee8e9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:14.860627 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 430/849] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:14 2022] PUT /identity/v3/projects/a434698321db46838c9669058a22e1ed/users/d166e918a92f42299a00779c51018e7c/roles/42aa243014164140995772918b521a86 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:16.974244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ff7bc-77c4-489e-a298-03f187a9cf57 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.974766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ff7bc-77c4-489e-a298-03f187a9cf57 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.974766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ff7bc-77c4-489e-a298-03f187a9cf57 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.976844 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 420/850] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:16.982112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.982509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.982663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.001185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:17.002367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:17.067035 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 431/851] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:28:17.336870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ff7bc-77c4-489e-a298-03f187a9cf57 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:17.352707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.436471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ff7bc-77c4-489e-a298-03f187a9cf57 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:17.469146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:17.469760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:17.470034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:17.470301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] PATH_INFO: `/v3/roles/42aa243014164140995772918b521a86` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.471669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] RBAC: Authorizing `identity:get_role(role_id=42aa243014164140995772918b521a86)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.473058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.474354 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 421/852] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/roles/42aa243014164140995772918b521a86 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:17.480780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:17.577351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606da883-0dbc-4444-ba2f-1683d687e359 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:17.591156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.617665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:17.618216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:17.618491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:17.618760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] PATH_INFO: `/v3/users/d166e918a92f42299a00779c51018e7c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.619903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] RBAC: Authorizing `identity:get_user(user_id=d166e918a92f42299a00779c51018e7c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.621337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.622907 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 432/853] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/users/d166e918a92f42299a00779c51018e7c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:17.628667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:17.706861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.726561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ffd69-bc6f-4cf1-ae75-722087631484 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:17.760478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:17.761074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:17.761351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:17.761620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.826485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.827951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.905171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.924696 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 422/854] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:28:17.931286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:18.029030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b227-db1d-43b4-9f22-d94a18709f0f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:18.061318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:18.061927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.062205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.062475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] PATH_INFO: `/v3/projects/a434698321db46838c9669058a22e1ed` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.063576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] RBAC: Authorizing `identity:get_project(project_id=a434698321db46838c9669058a22e1ed)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:18.065024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7576104-379d-43fb-8f7a-fd09b3090e0c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:18.066618 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 433/855] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/projects/a434698321db46838c9669058a22e1ed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:18.073517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:18.168021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2ad-cf36-41cb-9889-68104c7d1a8b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:18.200395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:18.200980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.201258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.201522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.202234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] RBAC: Adding query filter params (role.id=42aa243014164140995772918b521a86, scope.project.id=a434698321db46838c9669058a22e1ed, user.id=d166e918a92f42299a00779c51018e7c) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:18.202535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:18.203971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97ae5-89dd-427f-b38a-cb6d1d46f84c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:18.209492 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 423/856] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:18 2022] GET /identity/v3/role_assignments?user.id=d166e918a92f42299a00779c51018e7c&scope.project.id=a434698321db46838c9669058a22e1ed&role.id=42aa243014164140995772918b521a86 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:20.322473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee7d8-71c9-45b8-bd19-2bf38067f621 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.323045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee7d8-71c9-45b8-bd19-2bf38067f621 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.323045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee7d8-71c9-45b8-bd19-2bf38067f621 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.324376 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 434/857] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:20.329465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.329837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.330002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.348172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:20.349329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:20.387564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.413993 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 424/858] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:20.678285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ee7d8-71c9-45b8-bd19-2bf38067f621 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.729065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.778208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ee7d8-71c9-45b8-bd19-2bf38067f621 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.811477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.812117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.812395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.812666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.813764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.815175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4f67c-a8d7-4bee-ba6e-1100c94547e7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.816802 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 435/859] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:20.822523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.920707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6de12-f9b8-4a4d-ac53-e020dd180411 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.953886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.954471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.954740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.955004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.955647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.957084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c01d-d170-4797-882a-cb5d1b1775cc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.983935 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 425/860] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:28:20 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:23.141844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950a86-3898-4e7a-9ae3-e7ab7655deb7 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.142404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950a86-3898-4e7a-9ae3-e7ab7655deb7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.142404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950a86-3898-4e7a-9ae3-e7ab7655deb7 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.143714 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 436/861] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:23.149046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.149472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.149598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.168373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:23.169554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:23.189756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:23.237764 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 426/862] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:23.510851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22950a86-3898-4e7a-9ae3-e7ab7655deb7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:23.612004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22950a86-3898-4e7a-9ae3-e7ab7655deb7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.634949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:23.652712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.653317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.653587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.653852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.654936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:23.656394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eceff6-2a35-4338-a402-0b6a91d10182 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:23.657945 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 437/863] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:23.663921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:23.760646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a82cdb-8c0f-4a73-bf42-d414070c901b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.793497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.794088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.794368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.794637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.795279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:23.796733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fad2bd-0458-4872-ba7a-ef2fc278cd7c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:23.818193 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 427/864] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:23 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:25.977372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791cbdf-5d86-46e8-906e-8b42e663a03d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.977872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791cbdf-5d86-46e8-906e-8b42e663a03d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.977872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791cbdf-5d86-46e8-906e-8b42e663a03d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.979276 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 438/865] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:25.984361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.984777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.984905 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.002903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:26.004105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:26.011637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:26.070570 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 428/866] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:26.339508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791cbdf-5d86-46e8-906e-8b42e663a03d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:26.439604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791cbdf-5d86-46e8-906e-8b42e663a03d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:26.472868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:26.473469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.473741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.474004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.484425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:26.489155 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:26.490230 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:28:26.491111 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 439/867] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:26.496847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:26.592009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408449-0688-4114-bf9e-26d9b00885a4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:26.626006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:26.626603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.626883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.627155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.627815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:26.628149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:26.629520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:26.637582 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 429/868] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:26.643249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:26.690058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:26.741176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75313-3eec-49cf-ae88-6a571646e1c7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:26.774078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:26.774682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.774959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.775225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] PATH_INFO: `/v3/users/2d38bf72718c4435936e64f961411ec0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.787688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] RBAC: Authorizing `identity:get_user(user_id=2d38bf72718c4435936e64f961411ec0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:26.789654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:26.791202 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 440/869] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:26 2022] GET /identity/v3/users/2d38bf72718c4435936e64f961411ec0 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:26.796903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:26.800599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:26.894525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1ed-62ef-4bc7-a6ce-28b1a5c2f05e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:26.926900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:26.927506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.927783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.928080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] PATH_INFO: `/v3/projects/a4ed261829c24d7aab057f34a5a2b966` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.929764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ed261829c24d7aab057f34a5a2b966)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:26.931280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139064e-6f24-4017-b0b3-98dde7fd0228 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:26.932896 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 430/870] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:26 2022] GET /identity/v3/projects/a4ed261829c24d7aab057f34a5a2b966 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:26.938699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:27.034804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c0812-d13f-4a4b-aef7-1b88ab2e0759 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:27.037078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:27.068330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:27.068966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.069244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.069516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] PATH_INFO: `/v3/projects/a4ed261829c24d7aab057f34a5a2b966/users/2d38bf72718c4435936e64f961411ec0/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.071402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4ed261829c24d7aab057f34a5a2b966, user_id=2d38bf72718c4435936e64f961411ec0, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:27.072837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede91f85-9a0b-46c8-9066-10e087995868 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:27.084717 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 441/871] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:26 2022] PUT /identity/v3/projects/a4ed261829c24d7aab057f34a5a2b966/users/2d38bf72718c4435936e64f961411ec0/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:29.182077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6d3e-3df9-4521-ae71-719743e04663 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.182654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6d3e-3df9-4521-ae71-719743e04663 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.182654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6d3e-3df9-4521-ae71-719743e04663 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.183994 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 431/872] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:29.189125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.189518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.189676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.207389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:29.208591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:29.274087 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 442/873] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:29.538957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6d3e-3df9-4521-ae71-719743e04663 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:29.608399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:29.639804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6d3e-3df9-4521-ae71-719743e04663 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:29.672415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:29.673022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.673294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.673558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.685371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:29.690058 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:29.691219 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 432/874] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:29.697210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:29.785596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:29.793402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf758cd6-2c4c-4282-96fa-2a75f2b84d79 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:29.826966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:29.827557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.827833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.828133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.828785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:29.829085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:29.830441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:29.838408 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 443/875] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:29.844314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:29.939961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dd78b-ffca-452c-a174-5713c47bdf07 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:29.967720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:29.972902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:29.973536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.973812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.974082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] PATH_INFO: `/v3/users/2d38bf72718c4435936e64f961411ec0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.975190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] RBAC: Authorizing `identity:get_user(user_id=2d38bf72718c4435936e64f961411ec0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:29.977447 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:29.978980 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 433/876] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:29 2022] GET /identity/v3/users/2d38bf72718c4435936e64f961411ec0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:29.984554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:30.081020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f00c9-8348-4472-8732-da383a63d43c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:30.114548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:30.115126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:30.115398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:30.115660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:30.139721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:30.182792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:30.184234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:30.281282 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 444/877] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:28:30.287442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:30.384577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584707d2-01a1-4406-860e-a77ef8f3690b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:30.416607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:30.417217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:30.417492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:30.417760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] PATH_INFO: `/v3/projects/a4ed261829c24d7aab057f34a5a2b966` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:30.418854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] RBAC: Authorizing `identity:get_project(project_id=a4ed261829c24d7aab057f34a5a2b966)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:30.420310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa0eb-9c56-4108-a322-de7519669e4f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:30.421894 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 434/878] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:30 2022] GET /identity/v3/projects/a4ed261829c24d7aab057f34a5a2b966 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:30.427885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:30.482406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:30.525282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cca0-3e12-4ac5-9286-d97449f43e2c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:30.557720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:30.558302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:30.558578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:30.558848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:30.559561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=a4ed261829c24d7aab057f34a5a2b966, user.id=2d38bf72718c4435936e64f961411ec0) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:30.559893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:30.561310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716868-f98f-4fcf-9fdc-e69225c2ef43 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:30.566839 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 445/879] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:30 2022] GET /identity/v3/role_assignments?user.id=2d38bf72718c4435936e64f961411ec0&scope.project.id=a4ed261829c24d7aab057f34a5a2b966&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:32.705155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760a6a-06e6-43b6-b13c-8f3677ae4d18 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.705696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760a6a-06e6-43b6-b13c-8f3677ae4d18 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.705696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760a6a-06e6-43b6-b13c-8f3677ae4d18 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.707025 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 435/880] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:32.712940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd320-d95a-4ffe-9849-6e6a4f453a16 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.713365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd320-d95a-4ffe-9849-6e6a4f453a16 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.713493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd320-d95a-4ffe-9849-6e6a4f453a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.731687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b34cd320-d95a-4ffe-9849-6e6a4f453a16 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:32.732899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b34cd320-d95a-4ffe-9849-6e6a4f453a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.797069 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 446/881] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:33.065486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee760a6a-06e6-43b6-b13c-8f3677ae4d18 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.131031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:33.164898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee760a6a-06e6-43b6-b13c-8f3677ae4d18 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.197664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.198246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.198524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.198794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.199460 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.200845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513544-3977-43cf-be10-fa7af5616bab None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.215647 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 436/882] 10.222.0.33 () {60 vars in 1138 bytes} [Wed Oct 19 00:28:33 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:35.375204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e099e-cdb8-4f62-86af-bc607ac3cdcc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.375760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e099e-cdb8-4f62-86af-bc607ac3cdcc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.375760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e099e-cdb8-4f62-86af-bc607ac3cdcc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.377126 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 447/883] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:35.383118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.383508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.383759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.401638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:35.402810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:35.467451 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 437/884] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:35.740342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e099e-cdb8-4f62-86af-bc607ac3cdcc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.790763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:35.840781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e099e-cdb8-4f62-86af-bc607ac3cdcc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.873314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.873923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.874199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.874469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] PATH_INFO: `/v3/domains/ad3dba968ae149158155f84c2b547c6c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.885181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad3dba968ae149158155f84c2b547c6c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.886608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ab5e3-b619-44ce-b431-72fb71424ad0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.888191 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 448/885] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Oct 19 00:28:35 2022] GET /identity/v3/domains/ad3dba968ae149158155f84c2b547c6c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:35.894221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.950186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:35.990156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284c56-2956-4a6b-a63f-5ee084142401 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:36.024288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:36.024809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:36.025084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:36.025350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:36.025978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:36.027410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cedf3-79f6-4dbd-af5b-e373b27ec4d1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:36.052564 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 438/886] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:28:35 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:38.217076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc091b1-78c5-449e-a824-41ed63f4097a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.217628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc091b1-78c5-449e-a824-41ed63f4097a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.217628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc091b1-78c5-449e-a824-41ed63f4097a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.218953 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 449/887] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:38.224137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.224513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.224685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.243293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:38.244494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:38.308843 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 439/888] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:38.581488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc091b1-78c5-449e-a824-41ed63f4097a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.682929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc091b1-78c5-449e-a824-41ed63f4097a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.693340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.715944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.716548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.716820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.717087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] PATH_INFO: `/v3/domains/ad3dba968ae149158155f84c2b547c6c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.718177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad3dba968ae149158155f84c2b547c6c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.719593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c4101-717b-4302-b949-580915b3d2b4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.721150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 450/889] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Oct 19 00:28:38 2022] GET /identity/v3/domains/ad3dba968ae149158155f84c2b547c6c => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:38.728214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.770314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.830996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66655-b55b-4313-8676-aa248f6bb136 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.865085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.865637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.865932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.866206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.867537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.869007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddb930-723b-49b4-a87c-b2ca54b07696 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.890570 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 440/890] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:38 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:41.040504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6679-ec4d-4f98-b607-fd8d0ba4dbef None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.041091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6679-ec4d-4f98-b607-fd8d0ba4dbef None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.041091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6679-ec4d-4f98-b607-fd8d0ba4dbef None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.042353 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 451/891] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:41.047404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.047791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.047986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.066080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:41.067248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:41.131004 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 441/892] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:41.397201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6679-ec4d-4f98-b607-fd8d0ba4dbef None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.496725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6679-ec4d-4f98-b607-fd8d0ba4dbef None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.529022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.529618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.529893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.530161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.540485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:41.545245 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:41.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:28:41.547484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 452/893] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:41.552196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.578609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.651455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362be2b-b0d1-47e7-8399-36fbc4a509e6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.683622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.684247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.684527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.684799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.685453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:41.685754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.687128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.695767 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 442/894] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.701606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.742357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.800587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0893-8f5f-4e20-a2b0-5a4c1ac6a631 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.833227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.833842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.834115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.834382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] PATH_INFO: `/v3/users/c734306f3e414dfb884df0258f14fa70` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.847576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c734306f3e414dfb884df0258f14fa70)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.849030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.850590 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 453/895] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/users/c734306f3e414dfb884df0258f14fa70 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.856566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.940560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.953047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55740255-6d4c-4eff-b5f6-731da6b4becd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.985108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.985710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.985983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.986247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] PATH_INFO: `/v3/projects/50a50aee5c404701aadb97b4f157ab48` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.987329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] RBAC: Authorizing `identity:get_project(project_id=50a50aee5c404701aadb97b4f157ab48)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.988775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6250529-e2ed-4c65-9308-f574ec2180a0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.990342 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 443/896] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/projects/50a50aee5c404701aadb97b4f157ab48 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.996640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:42.087679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:42.093714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9bbd-95e5-4db7-9ab7-cabe6a5024b4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:42.126794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:42.127422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:42.127698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:42.128005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] PATH_INFO: `/v3/projects/50a50aee5c404701aadb97b4f157ab48/users/c734306f3e414dfb884df0258f14fa70/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:42.129868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a50aee5c404701aadb97b4f157ab48, user_id=c734306f3e414dfb884df0258f14fa70, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:42.131288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41d593-45fc-4bda-8479-8070fbcce288 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:42.143505 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 454/897] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:41 2022] PUT /identity/v3/projects/50a50aee5c404701aadb97b4f157ab48/users/c734306f3e414dfb884df0258f14fa70/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:44.251542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd699-e1b5-4948-befa-86721ad4623b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:44.252200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd699-e1b5-4948-befa-86721ad4623b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:44.252200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd699-e1b5-4948-befa-86721ad4623b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:44.253511 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 444/898] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:44.259653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:44.260084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:44.260220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:44.278114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:44.279285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:44.344572 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 455/899] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:28:44.618359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bd699-e1b5-4948-befa-86721ad4623b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:44.719380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bd699-e1b5-4948-befa-86721ad4623b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:44.751470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:44.752097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:44.752374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:44.752638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:44.763547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:44.768286 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:44.769420 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:28:44.770268 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 445/900] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:44.776233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:44.858273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:44.873850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c80d-e558-4c54-9342-a35948ed1a8f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:44.906924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:44.907512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:44.907787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:44.908153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:44.908798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:44.909101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:44.910462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:44.918380 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 456/901] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:44.924208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:44.942918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:45.022535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeff5e-5809-434e-933c-ba98588c83c5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:45.054455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:45.055069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.055342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.055604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] PATH_INFO: `/v3/users/c734306f3e414dfb884df0258f14fa70` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.056741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] RBAC: Authorizing `identity:get_user(user_id=c734306f3e414dfb884df0258f14fa70)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:45.058158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:45.059698 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 446/902] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:44 2022] GET /identity/v3/users/c734306f3e414dfb884df0258f14fa70 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:45.065417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:45.161227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afb5d-7d5a-4cd3-a1b2-fae658b1305a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:45.193209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:45.193792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.194063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.194329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.212370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:45.261718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:45.263141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:45.358344 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 457/903] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:28:45.364273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:45.445728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:45.461617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb9be-cc5b-4d54-81ab-5bc7dc0b3146 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:45.494598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:45.495207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.495480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.495747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] PATH_INFO: `/v3/projects/50a50aee5c404701aadb97b4f157ab48` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.496875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=50a50aee5c404701aadb97b4f157ab48)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:45.498298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342aa93-f92f-41cc-9ca9-eb7f09797aa6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:45.499908 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 447/904] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:45 2022] GET /identity/v3/projects/50a50aee5c404701aadb97b4f157ab48 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:45.505877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:45.553271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:45.603538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03205d-d3b7-4b98-8dec-cfb6015dcdb9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:45.637013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:45.637607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.637884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.638155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.638874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=50a50aee5c404701aadb97b4f157ab48, user.id=c734306f3e414dfb884df0258f14fa70) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:45.639178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:45.640622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c91685-d3b9-4eac-bf9f-1be9f5818f20 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:45.646177 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 458/905] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:45 2022] GET /identity/v3/role_assignments?user.id=c734306f3e414dfb884df0258f14fa70&scope.project.id=50a50aee5c404701aadb97b4f157ab48&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:55.489930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=24 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:55.643656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=44 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:41.726001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb178e0-9bdf-495e-8a89-f28090e093b8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.726703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb178e0-9bdf-495e-8a89-f28090e093b8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.726703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb178e0-9bdf-495e-8a89-f28090e093b8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.728299 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 448/906] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:41.733981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.734441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.734441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.759543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:41.760866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:41.848141 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 459/907] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:42.131735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb178e0-9bdf-495e-8a89-f28090e093b8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.262614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb178e0-9bdf-495e-8a89-f28090e093b8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.301285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.301932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.302211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.302484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.315174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.316730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:42.335446 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:42.336616 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:42.337612 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:42.337612 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:42.337612 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:42.341799 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 449/908] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:42.343370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.478433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00653e98-431e-488d-a846-48b8c92bd80d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.518273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:42.525244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.525863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.526145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.526416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.527072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:42.527372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.528882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86cbc-df63-4901-8c07-f4a93bdf3419 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.548884 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 460/909] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:42.550369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.629840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:42.703961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2dea-1099-44d8-8e10-3a9dc676ea1a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.759239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.759923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.760112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.760398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.761161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.762788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475486f8-f3ed-4026-b735-3a50ea2e99fe None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.791901 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 450/910] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Oct 19 00:29:42 2022] POST /identity/v3/users => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:45.176748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96f13-58a6-46ce-9e79-67b221fe3750 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.177282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96f13-58a6-46ce-9e79-67b221fe3750 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.177282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96f13-58a6-46ce-9e79-67b221fe3750 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.179308 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 461/911] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:45.185332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.185821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.185925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.205772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:45.206970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:45.290704 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 451/912] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:45.579389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d96f13-58a6-46ce-9e79-67b221fe3750 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:45.712630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d96f13-58a6-46ce-9e79-67b221fe3750 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:45.764002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:45.764630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.764904 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.765169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.779084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:45.785119 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:45.786275 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:45.789319 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 462/913] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:45.796899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:45.839100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:45.923204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd144-41f8-4631-9a48-2313cdf1e187 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:45.971577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:45.972259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.972576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.972920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.973648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:45.973943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:45.976025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:45.986320 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 452/914] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:45.993487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.058576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.122742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32481e-a45d-47bd-b614-12a097c2fee3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.168692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.169332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.169665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.169857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.182696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.184201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:46.201573 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:46.202650 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:46.204192 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:46.204192 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:46.204192 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:46.204192 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 463/915] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:46.208995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.323762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.327034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8493c-99fe-4898-a5c4-633f637d115e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.366635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.367225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.367497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.367760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.368498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:46.368802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.370465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.389803 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 453/916] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:46.391029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.500184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c444af-9344-400b-9a90-b900250461a0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.501848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.541716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.542336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.542617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.542884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] PATH_INFO: `/v3/users/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.550726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.552182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:46.565084 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:46.566301 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:46.567521 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:46.569619 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 464/917] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:46.576000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.695831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4d371-adba-4052-87f2-4944f5fdbbc5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.738474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.739156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.739477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.739705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.740511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:46.740821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.742422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.764386 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 454/918] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:46.769888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.892337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9332a95-42ff-4114-a8c0-a5f534412fda None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.931288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.931943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.932221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.932485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.944359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.946605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:46.963113 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:46.964451 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:46.965870 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:46.965870 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:46.965870 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:46.965870 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 465/919] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:46.970380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.992258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.095624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c3523-d282-4bc8-9792-62e3eb0b3aca None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.140176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.140991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.141335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.141819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.142528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:47.143018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.144735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.162485 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 455/920] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:47.165046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.184047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.294790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bbad-e1b8-49d6-ab13-8eaae2970b90 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.339943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.340742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.340968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.341243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.349214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.351801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:47.366524 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:47.367700 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:47.368737 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 466/921] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:47.376747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.464078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.487363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd310d-5a78-4bae-8291-f0401ad8817c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.524112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.524711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.524984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.525309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.526170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:47.526597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.528527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022983b7-8515-4b86-80dc-eb9ac174f0b7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.671184 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 456/922] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:47.677607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.767935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.797931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2d60-9bf0-4f42-9332-047f4fc81383 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.840479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.841204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.845794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.845794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/318bc2434e5f43439283d9419348c912/roles/4e9325334bef450897c41ec9b7e72a21` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.860167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=318bc2434e5f43439283d9419348c912, role_id=4e9325334bef450897c41ec9b7e72a21)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.861610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33850fd-fec2-44ea-8712-667c423c342a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.878341 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 467/923] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:47 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/318bc2434e5f43439283d9419348c912/roles/4e9325334bef450897c41ec9b7e72a21 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:29:50.186120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c98af-a1fa-4a05-a4c2-a048f4b6c34f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.186650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c98af-a1fa-4a05-a4c2-a048f4b6c34f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.186650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c98af-a1fa-4a05-a4c2-a048f4b6c34f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.188024 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 457/924] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:50.193450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.193863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.194594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.214173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:50.215361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:50.295909 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 468/925] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:50.579015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c98af-a1fa-4a05-a4c2-a048f4b6c34f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.700893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c98af-a1fa-4a05-a4c2-a048f4b6c34f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.740360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.741654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.741932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.742204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.749758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:50.754121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:50.760152 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:50.761491 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:50.762343 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 458/926] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:50.767708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.824438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:50.874756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367c4c7-53a9-4991-88a8-5d52480cdfb6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.911662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.912290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.912571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.913345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.914467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:50.914770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:50.916158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:50.924365 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 469/927] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Oct 19 00:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:50.931681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.038031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795cee6-2f67-4004-b61a-2116d319c93f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.075015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.075735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.076085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.076378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.088395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:51.089869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:51.105279 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:51.106392 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:51.107294 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:51.107294 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:51.107294 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:51.107294 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 459/928] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:51.112739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.224243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ec12-6714-406c-ad47-0e18a0009d59 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.242747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:51.264339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.265049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.265372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.265725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.266494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:51.266794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:51.268410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:51.285105 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 470/929] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:51.292645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.346070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:51.402828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6b7e-bb5f-44fe-a9a6-a67e6fc4b54c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.439000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.439614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.439924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.440197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.448705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:51.450138 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:51.462204 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:51.463206 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:51.464196 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 460/930] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:51.469672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.583954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b97-bdd5-428f-9c9d-5ff8dc317dc7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.626357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.626957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.627327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.627645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.628401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:51.629369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:51.630590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:51.655969 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 471/931] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:51.657286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.778495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7332-4b7c-4da1-a25e-df79c7fbd8ae None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.791461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:51.817374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.817979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.818251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.818519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.889630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:51.891001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.005300 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 461/932] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:29:52.011594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.047243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.124882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff8e-06d1-4409-a675-0c10316c120b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.167497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.168239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.168519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.168932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.182873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.184683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:52.203837 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:52.205047 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:52.206294 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:52.206294 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:52.206294 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:52.206294 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 472/933] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:52.212113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.223444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.320287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511b973-1048-4512-ab62-3096ce2189a8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.355070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.355699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.355982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.356245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.356886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.357175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.358537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.370317 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 462/934] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:52.376038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.476783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.494073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5bb7c-e46b-4918-96d0-172784daf1b0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.530376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.531001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.531277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.531546 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.539275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.540746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:52.552754 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:52.554123 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:29:52.555216 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:52.561214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.639802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.674786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a490-dca1-410e-b5be-3a9bf5023117 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.712663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.713264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.713536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.713814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.714556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.714928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.716573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f866c-ccb8-4fff-a3e6-ed73b6f84af8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.730063 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 463/936] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:52.736101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.847916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc4e7-9c40-4dbb-94d6-f68d3c40f9a6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.886175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.886763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.887038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.887304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.888057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] RBAC: Adding query filter params (role.id=4e9325334bef450897c41ec9b7e72a21, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=318bc2434e5f43439283d9419348c912) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.889027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.889777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7217-5107-449c-8c3e-fb38fbd5780f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.895465 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 474/937] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/role_assignments?user.id=318bc2434e5f43439283d9419348c912&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=4e9325334bef450897c41ec9b7e72a21 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:55.167666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda1f6-cb9b-4fc8-af55-a0be8ba147b3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:55.168277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda1f6-cb9b-4fc8-af55-a0be8ba147b3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:55.168277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda1f6-cb9b-4fc8-af55-a0be8ba147b3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:55.169578 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 464/938] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:55.175038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:55.175445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:55.175616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:55.195282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:55.196548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:55.199413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:55.271637 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 475/939] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:55.541393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cda1f6-cb9b-4fc8-af55-a0be8ba147b3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:55.659997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cda1f6-cb9b-4fc8-af55-a0be8ba147b3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:55.691782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:55.698877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:55.699715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:55.700025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:55.700293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:55.713199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:55.718705 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:55.720050 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:55.720914 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 465/940] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:55.726625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:55.831128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9296-94c4-478d-9166-67cefdebfbe1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:55.868133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:55.868735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:55.869075 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:55.869308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:55.870047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:55.870369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:55.871793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:55.880289 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 476/941] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:55.886951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:55.992289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb7be-356c-4b62-8081-90047c10e5f6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.028193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.028814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.029099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.029365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.039999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.041427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:56.059901 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:56.061100 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:56.066940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:56.066940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:56.066940 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:56.066940 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 466/942] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:56.067832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.071824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.187416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd5231-949f-4784-b766-9cfb817de9b8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.226377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.226979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.227257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.227785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.228454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:56.228755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.230151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.250440 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 477/943] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:56.251677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.304183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.369756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1a8cd-8741-4a63-930b-431ef1f5ec6f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.408184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.408795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.409075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.409407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.419117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.420603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:56.433148 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:56.434251 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:56.435403 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 467/944] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:56.440751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.511057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.552259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84426-7717-41a9-a51f-a9cf37b0423a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.588566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.589170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.589453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.589718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.590442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:56.590739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.592190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.614295 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 478/945] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:56.620487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.730503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ab3e-659b-4bac-bd21-6acfbf99a765 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.731998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.769611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.770320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.770607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.770859 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.783939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.785405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:56.799431 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:56.800445 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:56.801354 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:56.801354 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:56.801354 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:56.801354 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 468/946] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:56.807021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.919956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2f427-58d9-4fc3-beb5-62d3d0dd41c2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.941865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.957180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.957778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.958055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.958324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.958968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:56.959269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.960734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.972227 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 479/947] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:56.978471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:57.093324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ae777-1bab-4126-b7dd-30ad76bc764f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:57.131683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:57.132332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.132603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.132865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.139592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:57.141073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:57.152665 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:57.153687 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:29:57.154658 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 469/948] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:57.159989 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:57.273447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6cae-e9db-4e5f-be8f-6c25a5b70a9e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:57.314249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:57.314935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.315282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.315599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.316381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:57.316741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:57.318359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7865138-7df4-4c73-bfd9-2efd4db862c1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:57.332993 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 480/949] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:57.339593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:57.359140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:57.460868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753d3e-1632-4de8-a343-1ab0bfb9e0ca None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:57.503448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:57.504355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.504683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.505011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] PATH_INFO: `/v3/projects/2b84e4f9714649d581077ddac55b704a/users/318bc2434e5f43439283d9419348c912/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.507397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b84e4f9714649d581077ddac55b704a, user_id=318bc2434e5f43439283d9419348c912, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:57.508964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6ce7-7f1b-459e-988d-1407dac84b57 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:57.521218 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 470/950] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:57 2022] PUT /identity/v3/projects/2b84e4f9714649d581077ddac55b704a/users/318bc2434e5f43439283d9419348c912/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:59.898155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cf8b-a0c7-46bb-b52c-8af6f03ce922 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:59.898760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cf8b-a0c7-46bb-b52c-8af6f03ce922 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:59.898760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cf8b-a0c7-46bb-b52c-8af6f03ce922 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:59.900063 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 481/951] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:59.905990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:59.906411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:59.906565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:59.926800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:59.928186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:00.005054 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 471/952] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:00.292359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184cf8b-a0c7-46bb-b52c-8af6f03ce922 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.342437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.407514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184cf8b-a0c7-46bb-b52c-8af6f03ce922 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.443397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.444148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.444480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.444785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.457270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:30:00.462891 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:00.464058 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:00.465364 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:00.472043 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 482/953] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:00.472251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.473474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.580160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8e58-e30d-4d66-a85d-1f68b5cae7d8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.624181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.624838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.625113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.625376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.626151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:00.626456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.628086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.637364 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 472/954] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:00.644292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.753118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.757907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe496b5-4af7-41a4-97e0-7e026bd5c227 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.796529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.797275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.797553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.797823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.809707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.811612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:30:00.829154 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:00.831612 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:30:00.832997 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:30:00.832997 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:30:00.832997 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:00.832997 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 483/955] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:30:00.838827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.916613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.959590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e84746-c9ed-4071-b290-3302b5abb01b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.997246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.997860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.998160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.998411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.999059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:00.999360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:01.000822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:01.013398 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 473/956] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:01.020211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:01.136426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e622-ee17-4ff5-8efc-bcc13409786d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:01.175939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:01.176573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.176853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.177122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:01.185796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:01.187261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:30:01.199916 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:01.201129 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:01.202085 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 484/957] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:30:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:01.207316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:01.330519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e948b5-048d-4f4a-baa1-ed0a5bd3aa8e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:01.359110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:01.369008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:01.369628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.369911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.370182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:01.370923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:01.371227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:01.372743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:01.397604 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 474/958] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Oct 19 00:30:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:01.399474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:01.416530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:01.508940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3369-81f0-43e0-b931-2fa8fd56c54d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:01.545307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:01.545896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.546168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.546430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:01.618558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:01.620048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:01.635224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:01.722533 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 485/959] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Oct 19 00:30:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:30:01.728657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:01.829650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53587cc-ca83-4e65-bc80-f8bf467c838c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:01.862977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:01.863592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.863889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.864165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:01.874350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:01.875782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:30:01.890658 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:01.891727 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:30:01.892814 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:30:01.892814 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:30:01.892814 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:30:01.892814 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 475/960] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:01.897658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:01.994230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5304b-a2d3-4793-8e13-c06070d06304 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:02.007660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.028411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218898d3-dbef-476b-828a-664c203a539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:02.028994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218898d3-dbef-476b-828a-664c203a539b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.029262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218898d3-dbef-476b-828a-664c203a539b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.029532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218898d3-dbef-476b-828a-664c203a539b None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.030160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218898d3-dbef-476b-828a-664c203a539b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:02.030463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218898d3-dbef-476b-828a-664c203a539b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:02.031809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218898d3-dbef-476b-828a-664c203a539b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:02.042699 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 486/961] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Oct 19 00:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:02.048253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:02.082912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.145950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bed63-a27a-4375-bfcd-26e032e75292 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:02.177873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:02.178972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.179248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.179516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.186029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:02.187459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:30:02.198978 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:02.200065 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Oct 19 00:30:02.201147 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 476/962] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Oct 19 00:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:02.205894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218898d3-dbef-476b-828a-664c203a539b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:02.317588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218898d3-dbef-476b-828a-664c203a539b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:02.350946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:02.351533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.351806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.352122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.353049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:02.353346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:02.354761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c9a3-90f5-4c69-9293-18b36b36bdbf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:02.366850 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 487/963] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Oct 19 00:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:02.372999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:02.465152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.471318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f004f-7b70-4374-9474-2493d168d31f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:02.503393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:02.504008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.504286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.504556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.505270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] RBAC: Adding query filter params (role.id=98ac7afdb9e14f6e86d491d6e78191de, scope.project.id=2b84e4f9714649d581077ddac55b704a, user.id=318bc2434e5f43439283d9419348c912) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:02.505572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:02.507727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d598eeb-1031-44cd-82b6-8ecd1d31724a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:02.513283 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 477/964] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Oct 19 00:30:02 2022] GET /identity/v3/role_assignments?user.id=318bc2434e5f43439283d9419348c912&scope.project.id=2b84e4f9714649d581077ddac55b704a&role.id=98ac7afdb9e14f6e86d491d6e78191de => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:04.629751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c20e0-3d08-4e09-a63b-065a0b7574f4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:04.630150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c20e0-3d08-4e09-a63b-065a0b7574f4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:04.630300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c20e0-3d08-4e09-a63b-065a0b7574f4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:04.632329 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 488/965] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:04.637590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:04.637984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:04.638127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:04.656855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:04.658010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:04.722974 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 478/966] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:04.989976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c20e0-3d08-4e09-a63b-065a0b7574f4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:05.024608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:05.095600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c20e0-3d08-4e09-a63b-065a0b7574f4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:05.129558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:05.130180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.130454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.130721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.131298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:05.132858 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:05.141403 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:05.142653 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:05.143803 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 489/967] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:30:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:05.148663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:05.235909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:05.246699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9407c0-d8f3-48b4-aca1-96576d08c623 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:05.282060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:05.283040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.283199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.283463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.284290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:05.284645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:05.286269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22b45-69dc-4a29-b1f9-336e8ff6ef9c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:05.292662 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 479/968] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Oct 19 00:30:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:05.298641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:05.398786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:05.404771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d7d0-2d15-4a44-91d3-e9cda8dc7cab None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:05.437310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:05.437906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.438183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.438449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.439065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:05.439362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:05.440749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d719b6-308e-4d6c-9cf0-8ff2e90425f1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:05.445220 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 490/969] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Oct 19 00:30:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:07.578944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461524-44a2-4f5c-8aa1-825f63fbe3ec None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:07.579496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461524-44a2-4f5c-8aa1-825f63fbe3ec None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:07.579496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be461524-44a2-4f5c-8aa1-825f63fbe3ec None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:07.580845 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 480/970] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:07.586537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c0fd-84a0-46da-9509-186039baa2ee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:07.586936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c0fd-84a0-46da-9509-186039baa2ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:07.587088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c0fd-84a0-46da-9509-186039baa2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:07.605638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9255c0fd-84a0-46da-9509-186039baa2ee None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:07.606810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9255c0fd-84a0-46da-9509-186039baa2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:07.671715 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 491/971] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:07.937450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be461524-44a2-4f5c-8aa1-825f63fbe3ec None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:08.036997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be461524-44a2-4f5c-8aa1-825f63fbe3ec None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:08.069472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:08.070146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:08.070424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:08.070693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:08.071329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:08.072710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d973a-cdc7-4caf-87c6-7bda9cbd1486 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:08.087116 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 481/972] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Oct 19 00:30:07 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:10.249010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe54d-1750-4524-bb32-b2463c0b141a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:10.249559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe54d-1750-4524-bb32-b2463c0b141a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:10.249559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe54d-1750-4524-bb32-b2463c0b141a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:10.250893 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 492/973] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:10.255979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:10.256372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:10.257038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:10.276661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:10.277824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:10.287995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:10.355689 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 482/974] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:10.626883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe54d-1750-4524-bb32-b2463c0b141a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:10.720487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:10.732798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe54d-1750-4524-bb32-b2463c0b141a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:10.766156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:10.766773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:10.767051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:10.767325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:10.767939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:10.769314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:10.778705 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:10.779909 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:10.780780 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 493/975] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:30:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:10.785994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:10.882764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16463b2a-e782-4477-8181-1bff9888b789 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:10.916712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:10.917305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:10.917584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:10.917852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:10.918469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:10.918767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:10.920165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:10.925163 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 483/976] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Oct 19 00:30:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:10.931212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:11.030483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73821-8b70-4b37-bfc8-433a3138657c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:11.062703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:11.063290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.063569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.063841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.064550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] RBAC: Adding query filter params (interface=public, service_id=8d9e7766e2074a59a9b0e34640f4e377, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:11.064856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:11.066212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22b7da-008e-4847-aebf-a5793eaf333a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:11.071721 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 494/977] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Oct 19 00:30:10 2022] GET /identity/v3/endpoints?service_id=8d9e7766e2074a59a9b0e34640f4e377&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:11.077366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:11.081053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:11.174065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae473c29-3215-4a22-ac75-ad26caadab83 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:11.207438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:11.208055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.208331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.208604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.209199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:11.211125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5354b-29d4-41b4-beeb-342aba19adc0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:11.217823 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 484/978] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Oct 19 00:30:11 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:30:13.341011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613039-b5c9-401b-a7f0-f4eb98879f38 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.341569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613039-b5c9-401b-a7f0-f4eb98879f38 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.341569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613039-b5c9-401b-a7f0-f4eb98879f38 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.342886 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 495/979] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:13.348064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.348494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.348602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.367802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:13.368998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:13.427601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:13.433979 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 485/980] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:13.705190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e613039-b5c9-401b-a7f0-f4eb98879f38 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:13.724347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:13.807918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e613039-b5c9-401b-a7f0-f4eb98879f38 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:13.840476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:13.841080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.841351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.841612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.842168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:13.843519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:13.851981 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:13.856056 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Oct 19 00:30:13.857167 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 496/981] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Oct 19 00:30:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:13.859400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:13.954781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f2eb-f559-401f-9e84-b7c4db1130c5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:13.988815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:13.989406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.989678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.989944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.990561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:13.991537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:13.993005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56988554-5e37-4ce7-8361-517167e12f34 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:13.997946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 486/982] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Oct 19 00:30:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:14.003827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:14.084111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:14.103396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8632-dc7d-46e7-8354-d803d7fa9b5f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:14.135820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:14.136435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:14.136710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:14.136980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:14.137628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:14.138977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6dae6-de82-42db-add0-8e407fc540a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:14.157100 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 497/983] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:30:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:23.996092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=69 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:24.152987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:19.039288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12eae-337f-4008-837d-2c734e21eef9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:19.039873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12eae-337f-4008-837d-2c734e21eef9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:19.039873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12eae-337f-4008-837d-2c734e21eef9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:19.041459 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 487/984] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:19.046860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b19cc4-08c9-4660-bfa3-f41cdc544604 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:19.047312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b19cc4-08c9-4660-bfa3-f41cdc544604 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:19.047461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b19cc4-08c9-4660-bfa3-f41cdc544604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:19.141020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d1b19cc4-08c9-4660-bfa3-f41cdc544604 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:19.142220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d1b19cc4-08c9-4660-bfa3-f41cdc544604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:19.253622 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 498/985] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:19.552927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:19.553747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:19.554410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:19.555892 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 488/986] 10.222.0.33 () {54 vars in 964 bytes} [Wed Oct 19 00:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:19.562443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d560d-63da-44b1-b6aa-5e6500fc99a9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:19.562775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d560d-63da-44b1-b6aa-5e6500fc99a9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:19.562999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d560d-63da-44b1-b6aa-5e6500fc99a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:19.656939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-710d560d-63da-44b1-b6aa-5e6500fc99a9 None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:19.658177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-710d560d-63da-44b1-b6aa-5e6500fc99a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:19.680504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:19.740363 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 499/987] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Oct 19 00:31:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:19.749291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:19.751092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:19.865862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211e17-ec0d-49cf-8419-5c42a6fc48c8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:19.943248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:19.944601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:19.944982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:19.945259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:19.946878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:20.004881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:20.063399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:20.064877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd3313-6d1b-44fe-9dc1-f327088e00ab service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:20.084642 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 489/988] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:22.544517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:22.545028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:22.545123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:22.546399 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 500/989] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:22.551523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8eeb-ed43-4da7-9df1-9e3c75517f8a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:22.551988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8eeb-ed43-4da7-9df1-9e3c75517f8a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:22.552171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8eeb-ed43-4da7-9df1-9e3c75517f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:22.624337 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4aea8eeb-ed43-4da7-9df1-9e3c75517f8a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:22.625547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4aea8eeb-ed43-4da7-9df1-9e3c75517f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:22.719705 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 490/990] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:23.003151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:23.004812 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:23.114320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933781e-922b-4f21-be87-6931bad3e85c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:23.188343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:23.190900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:23.191566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:23.191881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:23.192204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:23.194916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:23.306701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:23.308181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87350682-c65d-4c2c-a794-4a22dfbe205a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:23.327691 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 501/991] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:25.789678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:25.790229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:25.790229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:25.791546 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 491/992] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:25.796736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22e11-e139-49e1-8e34-67a3c9c30398 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:25.797178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22e11-e139-49e1-8e34-67a3c9c30398 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:25.797277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22e11-e139-49e1-8e34-67a3c9c30398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:25.864000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-00d22e11-e139-49e1-8e34-67a3c9c30398 None None] MFA Rules not processed for user `d668b39e40ef454bba240eec588f5442`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:25.865197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-00d22e11-e139-49e1-8e34-67a3c9c30398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:25.917363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:25.962155 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 502/993] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:26.246824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:26.248381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:26.258161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:26.352380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305667b7-59b6-405d-8fe8-797fad398bf4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:26.424603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:26.425191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:26.425463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:26.425729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:26.427306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:26.487200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:26.534221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:26.535643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f73d-4fc8-40f5-9de6-32412a423568 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:26.553588 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 492/994] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:29.236190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:29.236756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:29.236756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:29.238075 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 503/995] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:29.244106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fbb7-df0f-47c6-8c6c-2dbf5f465c6b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:29.244547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fbb7-df0f-47c6-8c6c-2dbf5f465c6b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:29.244642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fbb7-df0f-47c6-8c6c-2dbf5f465c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:29.314078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f201fbb7-df0f-47c6-8c6c-2dbf5f465c6b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:29.315288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f201fbb7-df0f-47c6-8c6c-2dbf5f465c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:29.409777 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 493/996] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:29.692550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:29.694522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:29.796444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68a45a-dbdd-4015-b382-8e1aaba9e5f9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:29.869114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:29.869643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:29.869919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:29.870188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:29.871762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:29.878570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:29.980270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:29.981700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67e1a7-033a-4d2c-83f1-699e49cabe90 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:29.999089 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 504/997] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:32.786127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:32.786728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:32.786728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:32.788532 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 494/998] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:32.793928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad07ee-d7ac-4bb6-9ac8-7f485c621313 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:32.794365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad07ee-d7ac-4bb6-9ac8-7f485c621313 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:32.794474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad07ee-d7ac-4bb6-9ac8-7f485c621313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:32.864214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-eaad07ee-d7ac-4bb6-9ac8-7f485c621313 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:32.865447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eaad07ee-d7ac-4bb6-9ac8-7f485c621313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:32.931414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:32.975727 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 505/999] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:33.258190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:33.259796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:33.281785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:33.368449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c05a90-0299-4971-9e97-9253a049fd24 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:33.440952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:33.441547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:33.441821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:33.442082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:33.443658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:33.515056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:33.555142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:33.556624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77441b-cfa3-45a9-a718-556b1a8da5ac service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:33.574738 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 495/1000] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:35.782233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed4ca-e67a-403b-8da0-36e349e852b7 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:35.782797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed4ca-e67a-403b-8da0-36e349e852b7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:35.782797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed4ca-e67a-403b-8da0-36e349e852b7 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:35.784145 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 506/1001] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:35.789599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f220-5394-427b-9398-3ba538b222cd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:35.790077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f220-5394-427b-9398-3ba538b222cd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:35.790171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f220-5394-427b-9398-3ba538b222cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:35.856927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a223f220-5394-427b-9398-3ba538b222cd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:35.858126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a223f220-5394-427b-9398-3ba538b222cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:35.962363 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 496/1002] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:36.298728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:36.299011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:36.299278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:36.300641 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 507/1003] 10.222.0.33 () {54 vars in 964 bytes} [Wed Oct 19 00:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:36.306597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ef50-3cba-4836-8c0b-c91e6f1a7c5f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:36.306880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ef50-3cba-4836-8c0b-c91e6f1a7c5f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:36.307150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ef50-3cba-4836-8c0b-c91e6f1a7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:36.346270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:36.394237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-00a3ef50-3cba-4836-8c0b-c91e6f1a7c5f None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:36.395410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-00a3ef50-3cba-4836-8c0b-c91e6f1a7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:36.474033 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 497/1004] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Oct 19 00:31:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:31:36.483257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:36.485000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:36.594153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14db550-a545-4b41-b8e7-804dde9b7bae None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:36.671627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:36.672559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:36.672837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:36.673103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:36.674693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:36.691542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:36.792106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:36.793557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891d474-bda7-44e3-b9b1-ef8efe531239 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:36.811947 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 508/1005] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:39.274196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.274724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.274724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.276153 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 498/1006] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:39.281843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ed79-2491-4b7e-b5eb-660fa4115c7e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.282333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ed79-2491-4b7e-b5eb-660fa4115c7e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.282432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ed79-2491-4b7e-b5eb-660fa4115c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.354840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-cfe0ed79-2491-4b7e-b5eb-660fa4115c7e None None] MFA Rules not processed for user `d668b39e40ef454bba240eec588f5442`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:39.356404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cfe0ed79-2491-4b7e-b5eb-660fa4115c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:39.425745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:39.458865 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 509/1007] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:39.745915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.747432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:39.858696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11deeb22-8072-442b-9ec9-9bc4156b539d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.880545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:39.937872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.938752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.939290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.939882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.945834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:40.066081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.067529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef40dfc-1c2f-487c-9760-a1694660973a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.086484 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 499/1008] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:42.642572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:42.643033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:42.643236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:42.644661 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 510/1009] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:42.650683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b615-1913-4d5c-a294-b86e4333d0a4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:42.651065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b615-1913-4d5c-a294-b86e4333d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:42.651234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b615-1913-4d5c-a294-b86e4333d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:42.714133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:42.717015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6791b615-1913-4d5c-a294-b86e4333d0a4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:42.718802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6791b615-1913-4d5c-a294-b86e4333d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:42.814668 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 500/1010] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:43.098142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:43.099673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:43.202598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17505a-c23e-49ec-bfbd-bb53f3cf2ceb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:43.276210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:43.276794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:43.277069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:43.277337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:43.278925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:43.306550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:43.389667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:43.391018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4332f6-5450-4367-bbce-e8bc89bc1449 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:43.409181 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 511/1011] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:45.596295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.596771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.596872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.598150 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 501/1012] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:45.604144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7cd1-0ea1-4a36-b74b-9be9121b9367 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.604590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7cd1-0ea1-4a36-b74b-9be9121b9367 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.604691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7cd1-0ea1-4a36-b74b-9be9121b9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.671565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-672f7cd1-0ea1-4a36-b74b-9be9121b9367 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:45.672805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-672f7cd1-0ea1-4a36-b74b-9be9121b9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:45.747792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:45.769706 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 512/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:46.056000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:46.057532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:46.158852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4163-ef7c-4687-ab1a-18ae228edf80 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:46.187065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:46.230984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:46.231569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:46.231842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:46.232135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:46.233707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:46.342468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:46.343825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db9455-7e6e-4f87-94c9-21c177fb7531 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:46.361959 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 502/1014] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:48.821673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:48.822222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:48.822222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:48.823567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 513/1015] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:48.828863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8b7e-4083-4379-bb90-b3b8ec419569 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:48.829304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8b7e-4083-4379-bb90-b3b8ec419569 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:48.829418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8b7e-4083-4379-bb90-b3b8ec419569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:48.897537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-07ee8b7e-4083-4379-bb90-b3b8ec419569 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:48.898688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07ee8b7e-4083-4379-bb90-b3b8ec419569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:48.906982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:48.995269 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 503/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:49.279884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.281418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:49.382732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7614-f3c9-4977-892e-74141dfddfcb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.454415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.455006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.455279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.455547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:49.457179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:49.492637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:49.565668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:49.567085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5372039-5708-4c2c-a91e-e2d61a5656cc service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:49.586106 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 514/1017] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:53.692408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:53.692964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:53.692964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:53.694561 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 504/1018] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:53.700214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422751-f5e4-40c7-8905-09aa79fe43f0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:53.700658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422751-f5e4-40c7-8905-09aa79fe43f0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:53.700903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422751-f5e4-40c7-8905-09aa79fe43f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:53.768165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4c422751-f5e4-40c7-8905-09aa79fe43f0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:53.769284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c422751-f5e4-40c7-8905-09aa79fe43f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:53.858074 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:53.869925 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 515/1019] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:54.154209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:54.155834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:54.262933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfbcb5-2d14-42a2-9682-945f9fcf01b3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:54.302832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:54.340461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:54.341062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:54.341334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:54.341600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:54.343165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:54.452303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:54.453663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407f68-ede9-4f75-a147-e685ee97664a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:54.472361 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 505/1020] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:57.430886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:57.431451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:57.431451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:57.432941 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 516/1021] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:57.438200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d2ec-291f-464c-bf7c-dc6b0739afaa None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:57.438607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d2ec-291f-464c-bf7c-dc6b0739afaa None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:57.438744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d2ec-291f-464c-bf7c-dc6b0739afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:57.505682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fe02d2ec-291f-464c-bf7c-dc6b0739afaa None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:57.506914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fe02d2ec-291f-464c-bf7c-dc6b0739afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:57.525693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:57.612341 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 506/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:57.902374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:57.904047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:58.010067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e6d8-16b7-415a-acf9-81d5133d8ffa None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:58.084242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:58.085145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:58.085600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:58.085867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:58.087501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:58.132981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:58.200422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:58.201868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635c125-37e6-4403-b496-cbd3035f23d4 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:58.220735 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 517/1023] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:02.728021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:02.728578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:02.728578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:02.729990 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 507/1024] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:02.735845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70d02-8fe3-4a23-bc96-ab4fcde1de93 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:02.736301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70d02-8fe3-4a23-bc96-ab4fcde1de93 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:02.736401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70d02-8fe3-4a23-bc96-ab4fcde1de93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:02.807011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-20e70d02-8fe3-4a23-bc96-ab4fcde1de93 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:02.808188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-20e70d02-8fe3-4a23-bc96-ab4fcde1de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:02.905576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:02.907794 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 518/1025] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:32:03.189875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:03.191398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:03.294233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0d62-72e1-412a-834f-93c82111fd2a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:03.343393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:03.369754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:03.370339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:03.370611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:03.370877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:03.372492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:03.481210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:03.482633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12a974-8db1-4f12-84c0-c7c090c57465 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:03.500500 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 508/1026] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:08.437361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78f178-97d7-42d2-82a4-e76d6062efcb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.437810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78f178-97d7-42d2-82a4-e76d6062efcb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.437891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78f178-97d7-42d2-82a4-e76d6062efcb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.439525 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 519/1027] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:08.445080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f013-d98e-4b78-a57f-6ae51bd633c7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.445625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f013-d98e-4b78-a57f-6ae51bd633c7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.445625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f013-d98e-4b78-a57f-6ae51bd633c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.577716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-02f8f013-d98e-4b78-a57f-6ae51bd633c7 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:08.579345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-02f8f013-d98e-4b78-a57f-6ae51bd633c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:08.600996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:08.745441 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 509/1028] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:32:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:12.847969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287dbf-1dc2-4b5d-b17f-670134a7e5f3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:12.848491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287dbf-1dc2-4b5d-b17f-670134a7e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:12.848817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287dbf-1dc2-4b5d-b17f-670134a7e5f3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:12.851016 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 520/1029] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:12.856480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf5e00-aa3e-447a-aa03-6a241a05ccf2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:12.857005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf5e00-aa3e-447a-aa03-6a241a05ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:12.857227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf5e00-aa3e-447a-aa03-6a241a05ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:12.943940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f0cf5e00-aa3e-447a-aa03-6a241a05ccf2 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:12.945244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f0cf5e00-aa3e-447a-aa03-6a241a05ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:13.030247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:13.070372 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 510/1030] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:14.338266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d46a-596b-457e-8548-2f9b6c1876fd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:14.338790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d46a-596b-457e-8548-2f9b6c1876fd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:14.338903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d46a-596b-457e-8548-2f9b6c1876fd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:14.340322 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 521/1031] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:14.345376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c49-170c-4e4c-84a9-55223cbb4d94 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:14.345796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c49-170c-4e4c-84a9-55223cbb4d94 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:14.345919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c49-170c-4e4c-84a9-55223cbb4d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:14.423192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-19782c49-170c-4e4c-84a9-55223cbb4d94 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:14.424427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-19782c49-170c-4e4c-84a9-55223cbb4d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:14.534647 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 511/1032] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:32:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:18.224307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd02-b15a-40e7-98a2-8ff2b5c53905 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:18.225909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd02-b15a-40e7-98a2-8ff2b5c53905 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:18.226196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd02-b15a-40e7-98a2-8ff2b5c53905 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:18.227541 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 522/1033] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:18.233447 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686617-ec54-40f6-8d08-50d19ed08130 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:18.234330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686617-ec54-40f6-8d08-50d19ed08130 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:18.234822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686617-ec54-40f6-8d08-50d19ed08130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:18.275575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:18.314745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-28686617-ec54-40f6-8d08-50d19ed08130 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:18.315975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-28686617-ec54-40f6-8d08-50d19ed08130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:18.421075 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 512/1034] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:18.724574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:18.725198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:18.725718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:18.727495 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 523/1035] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:18.737598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c7b3-dd48-4a88-82b2-76a252b73aa9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:18.737929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c7b3-dd48-4a88-82b2-76a252b73aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:18.738241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c7b3-dd48-4a88-82b2-76a252b73aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:18.824786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ef22c7b3-dd48-4a88-82b2-76a252b73aa9 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:18.825991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ef22c7b3-dd48-4a88-82b2-76a252b73aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:18.882680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:18.966995 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 513/1036] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:18.976006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:18.977812 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:19.140535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf8a8-d6a2-40d3-92e3-1b7cd9a7373e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:19.217542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:19.258997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:19.259611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:19.259887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:19.260155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:19.261748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:19.360402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:19.362007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98e222-eeca-4a9a-bc34-7e4462acc516 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:19.382746 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 524/1037] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:21.752174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:21.752705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:21.752705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:21.754219 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 514/1038] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:21.759811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974be2-a3a4-4b29-b1a2-a8682d77fa62 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:21.760251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974be2-a3a4-4b29-b1a2-a8682d77fa62 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:21.760466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974be2-a3a4-4b29-b1a2-a8682d77fa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:21.841666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3a974be2-a3a4-4b29-b1a2-a8682d77fa62 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:21.842861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a974be2-a3a4-4b29-b1a2-a8682d77fa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:21.889096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:21.958216 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 525/1039] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:22.256185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:22.258552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:22.430532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a8c15-6c53-42f4-ada5-3ba98c1e9ba1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:22.442503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:22.569875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:22.570483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:22.570760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:22.571036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:22.572665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:22.672348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:22.673958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cac71-1e05-49ee-93eb-fdd20479c199 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:22.692639 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 515/1040] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:25.189295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67964-4ebb-474c-a0d3-f9a95ef5a439 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:25.189872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67964-4ebb-474c-a0d3-f9a95ef5a439 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:25.189872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67964-4ebb-474c-a0d3-f9a95ef5a439 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:25.191416 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 526/1041] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:25.197326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e84e-70b9-4760-81ab-53996be31017 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:25.197799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e84e-70b9-4760-81ab-53996be31017 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:25.197928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e84e-70b9-4760-81ab-53996be31017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:25.213671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:25.268072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-59c3e84e-70b9-4760-81ab-53996be31017 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:25.269282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-59c3e84e-70b9-4760-81ab-53996be31017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:25.372605 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 516/1042] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:25.666421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:25.666848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:25.667221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:25.668849 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 527/1043] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:25.674609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c74b8-7081-44bb-9bbb-22b9199ef2f0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:25.674903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c74b8-7081-44bb-9bbb-22b9199ef2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:25.675197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c74b8-7081-44bb-9bbb-22b9199ef2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:25.754605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f58c74b8-7081-44bb-9bbb-22b9199ef2f0 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:25.755830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f58c74b8-7081-44bb-9bbb-22b9199ef2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:25.792798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:25.880424 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 517/1044] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:32:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:25.888419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:25.889995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:26.052797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94eaa-4925-439c-9881-d173a86cb765 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:26.076000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:26.181752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:26.182286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:26.182731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:26.183003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:26.184639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:26.290729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:26.292355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ab78e-65a5-49aa-9586-0d2f04f08720 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:26.312319 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 528/1045] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:32:26.468799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099cdd7-7b8c-48bb-a0fd-13b52876252f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:26.469347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099cdd7-7b8c-48bb-a0fd-13b52876252f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:26.469347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099cdd7-7b8c-48bb-a0fd-13b52876252f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:26.470810 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 518/1046] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:26.476602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e742-d237-47e8-9ab7-a923561365de None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:26.476944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e742-d237-47e8-9ab7-a923561365de None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:26.477134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e742-d237-47e8-9ab7-a923561365de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:26.512182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:26.557174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2300e742-d237-47e8-9ab7-a923561365de None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:26.558918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2300e742-d237-47e8-9ab7-a923561365de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:26.682320 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 529/1047] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:27.020646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:27.020646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:27.020646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:27.023544 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 519/1048] 10.222.0.33 () {54 vars in 963 bytes} [Wed Oct 19 00:32:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:27.028736 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6daf-a091-4096-93eb-9baadfdd8b45 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:27.029128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6daf-a091-4096-93eb-9baadfdd8b45 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:27.029496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6daf-a091-4096-93eb-9baadfdd8b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:27.110657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4bff6daf-a091-4096-93eb-9baadfdd8b45 None None] MFA Rules not processed for user `8b209bd7afbd44ceabe2d9b71e7585e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:27.112037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4bff6daf-a091-4096-93eb-9baadfdd8b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:27.163690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:27.196534 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 530/1049] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Oct 19 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:27.204389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:27.206140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:27.319723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5e79c-05f8-470f-8723-e53a6201aed9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:27.363652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:27.407548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:27.408170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:27.408494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:27.408754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:27.410343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:27.548432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:27.550386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9634ea-691a-4d0d-84c5-3425197bc5a0 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:27.578533 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 520/1050] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:28.565647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:28.566202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:28.566202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:28.567567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 531/1051] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:28.573252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552863f-d9bd-4f8c-b3ff-77d0b822ec9f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:28.573669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552863f-d9bd-4f8c-b3ff-77d0b822ec9f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:28.573935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552863f-d9bd-4f8c-b3ff-77d0b822ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:28.650869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6552863f-d9bd-4f8c-b3ff-77d0b822ec9f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:28.652114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6552863f-d9bd-4f8c-b3ff-77d0b822ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:28.673371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:28.751655 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 521/1052] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:29.038482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:29.040111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:29.205097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838172-5479-48ff-8d06-5b0ef761ea94 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:29.262304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:29.329350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:29.329941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:29.330214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:29.330476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:29.332091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:29.425935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:29.427519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230382-c360-4a12-988c-69d1781ed4ba service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:29.446777 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 532/1053] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:31.717419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:31.717986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:31.717986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:31.719438 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 522/1054] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:31.724425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5c02a-d91d-44ad-8333-49a007ac34f5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:31.724836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5c02a-d91d-44ad-8333-49a007ac34f5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:31.725543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5c02a-d91d-44ad-8333-49a007ac34f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:31.796165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a8d5c02a-d91d-44ad-8333-49a007ac34f5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:31.797364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a8d5c02a-d91d-44ad-8333-49a007ac34f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:31.804771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:31.907621 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 533/1055] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:32.197662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:32.199163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:32.359763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef7af-1de1-456c-acd3-01e88b89b88b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:32.363726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:32.478062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:32.478570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:32.478849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:32.479121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:32.480715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:32.573121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:32.574737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328019-efbc-4120-8669-2d686405cfad service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:32.594080 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 523/1056] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:34.830254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:34.830816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:34.830816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:34.832413 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 534/1057] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:34.838135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7a2d-77cb-4b5e-8e4f-54ca7d31e467 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:34.838709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7a2d-77cb-4b5e-8e4f-54ca7d31e467 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:34.838709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7a2d-77cb-4b5e-8e4f-54ca7d31e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:34.849742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:34.909779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ea4f7a2d-77cb-4b5e-8e4f-54ca7d31e467 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:34.910990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ea4f7a2d-77cb-4b5e-8e4f-54ca7d31e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:35.019719 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 524/1058] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:35.338194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:35.340002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:35.512903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:35.525253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1849ac-e868-4f70-be1c-8d8425110e7a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:35.650149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:35.650755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:35.651033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:35.651298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:35.652929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:35.753523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:35.755135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f451-f06a-4e8f-9ec7-175fb98bc2ff service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:35.765911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:35.775397 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 535/1059] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:38.219424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:38.219990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:38.220076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:38.221589 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 525/1060] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:38.227842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed93977-ef72-4b5c-9e22-27e2b9f432b8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:38.228305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed93977-ef72-4b5c-9e22-27e2b9f432b8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:38.228594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed93977-ef72-4b5c-9e22-27e2b9f432b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:38.316062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-eed93977-ef72-4b5c-9e22-27e2b9f432b8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:38.317282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eed93977-ef72-4b5c-9e22-27e2b9f432b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:38.421034 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 536/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:38.797996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:38.799526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:38.888743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:38.953683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a4309-24ba-4eae-ab61-cd557c61e9a0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:39.092546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:39.093382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:39.093755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:39.094128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:39.096349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:39.150481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:39.192794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:39.195655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45334f23-54ac-43a1-a029-04e25558ac3e service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:39.219570 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 526/1062] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:41.576138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:41.576729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:41.576729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:41.578009 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 537/1063] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:41.583303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5299c3a-3a2e-46d4-97a2-900a6e149988 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:41.583707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5299c3a-3a2e-46d4-97a2-900a6e149988 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:41.583958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5299c3a-3a2e-46d4-97a2-900a6e149988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:41.660244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a5299c3a-3a2e-46d4-97a2-900a6e149988 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:41.661468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a5299c3a-3a2e-46d4-97a2-900a6e149988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:41.773852 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 527/1064] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:42.071473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:42.073029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:42.155138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:42.227184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450920-ea4d-4213-b59f-566320bd43e8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:42.344621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:42.345189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:42.345468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:42.345735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:42.347341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:42.388593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:42.440141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:42.441734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960ec50-1108-473e-992a-aceeaff4f032 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:42.460611 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 538/1065] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:42.831566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298d12d-08bc-45e1-993b-5f3768049f01 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:42.832172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298d12d-08bc-45e1-993b-5f3768049f01 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:42.832270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298d12d-08bc-45e1-993b-5f3768049f01 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:42.833570 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 528/1066] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:42.839814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cea88-6575-46c3-8bb7-549447b00034 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:42.840253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cea88-6575-46c3-8bb7-549447b00034 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:42.840426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cea88-6575-46c3-8bb7-549447b00034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:42.906337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f77cea88-6575-46c3-8bb7-549447b00034 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:42.907475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f77cea88-6575-46c3-8bb7-549447b00034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:43.005265 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 539/1067] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:43.308813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:43.309104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:43.309378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:43.310711 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 529/1068] 10.222.0.33 () {54 vars in 962 bytes} [Wed Oct 19 00:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:43.316049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b76-193e-48c4-a907-9ac7e550b3ba None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:43.316338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b76-193e-48c4-a907-9ac7e550b3ba None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:43.316610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b76-193e-48c4-a907-9ac7e550b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:43.332967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:43.398978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e6853b76-193e-48c4-a907-9ac7e550b3ba None None] MFA Rules not processed for user `6b298c229b7f402c9883e743c82110a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:43.400226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e6853b76-193e-48c4-a907-9ac7e550b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:43.477058 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 540/1069] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Oct 19 00:32:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:43.486355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:43.488054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:43.519855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:43.593891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a9908-54b1-4847-a95e-57e3c0b2a689 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:43.671917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:43.672530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:43.672809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:43.673081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:43.674667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:43.754620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:43.787893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:43.789348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a8dc-ee3c-44cc-8dfe-0a44ee39407a service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:43.807944 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 530/1070] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:44.553756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00901-f059-4c67-8c04-af03f1233280 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:44.554243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00901-f059-4c67-8c04-af03f1233280 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:44.554361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00901-f059-4c67-8c04-af03f1233280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:44.631000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-98d00901-f059-4c67-8c04-af03f1233280 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:44.632241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-98d00901-f059-4c67-8c04-af03f1233280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:44.689279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:44.690517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcd0a-1166-47af-a99d-858a83cebbf5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:44.690981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcd0a-1166-47af-a99d-858a83cebbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:44.691146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcd0a-1166-47af-a99d-858a83cebbf5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:44.692563 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 531/1071] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:44.698369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:44.698657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:44.698933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:44.723238 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 541/1072] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:44.768013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:44.769335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:44.773261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1765aac-13a2-4ee6-bbcd-8bc6e2cfe5fa None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:44.773578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1765aac-13a2-4ee6-bbcd-8bc6e2cfe5fa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:44.773851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1765aac-13a2-4ee6-bbcd-8bc6e2cfe5fa None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:44.775200 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 542/1073] 10.222.0.33 () {54 vars in 943 bytes} [Wed Oct 19 00:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:32:44.782204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:44.782549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:44.782827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:44.861435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] MFA Rules not processed for user `d005fde5a49a456ab4769be3af172dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:44.862650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:44.869206 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 532/1074] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:32:44.970352 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 543/1075] 10.222.0.33 () {58 vars in 1040 bytes} [Wed Oct 19 00:32:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:32:44.979981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:44.981249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.020886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:45.086711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ba31-afdb-4a7a-a5d8-488e7bbfec9a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:45.165236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:45.166419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.190326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:45.190925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:45.191194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:45.191460 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:45.193100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.200286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:45.251297 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:45.267355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650afa2-654b-4d27-bf47-5dd8f6d5c8c1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:45.283403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:45.285084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cb456-1132-4eac-8753-99d29e86988d service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:45.294242 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 533/1076] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:32:45.403835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:45.404486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:45.404766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:45.405035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:45.406675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.456950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:45.512167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:45.513774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c906e4-d28e-493e-91de-dc826f7ad1b1 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:45.532931 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 544/1077] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:47.858389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.859003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.859003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.864359 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 534/1078] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:47.866489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f792c-8d03-4a8c-b2bf-385dc98bbb0b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.867840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f792c-8d03-4a8c-b2bf-385dc98bbb0b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.868353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f792c-8d03-4a8c-b2bf-385dc98bbb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.944794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-831f792c-8d03-4a8c-b2bf-385dc98bbb0b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:47.946029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-831f792c-8d03-4a8c-b2bf-385dc98bbb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.059416 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 545/1079] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:48.363280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:48.364844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.525557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855448d6-90b4-4ac5-a2b2-eae8d1b1db5c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:48.585554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:48.675814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:48.676484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:48.676767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:48.677039 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:48.678850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.783943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:48.785695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608737b-dec7-41ce-822d-961e07e308ad service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:48.805927 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 535/1080] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:51.041467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:51.042032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:51.042032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:51.043359 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 546/1081] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:51.049082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b358d8-3344-40ec-82db-f4bc4ffbbc75 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:51.049575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b358d8-3344-40ec-82db-f4bc4ffbbc75 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:51.049662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b358d8-3344-40ec-82db-f4bc4ffbbc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:51.122804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-66b358d8-3344-40ec-82db-f4bc4ffbbc75 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:51.124083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-66b358d8-3344-40ec-82db-f4bc4ffbbc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:51.127001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:51.241271 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 536/1082] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:51.595296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:51.596961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:51.625154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:51.770835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33719-69b8-43a7-8b38-5aa9d91144b2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:51.878805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:51.905112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:51.905726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:51.906004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:51.906274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:51.907942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:52.012431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:52.014043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b88e1c-df94-4df0-8695-a3cb4fcb86e3 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:52.033953 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 547/1083] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:54.262533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:54.263100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:54.263100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:54.264421 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 537/1084] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:54.269777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408735d-55db-40d5-99e7-cb2b7cd8a812 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:54.270233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408735d-55db-40d5-99e7-cb2b7cd8a812 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:54.270350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408735d-55db-40d5-99e7-cb2b7cd8a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:54.350398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8408735d-55db-40d5-99e7-cb2b7cd8a812 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:54.351868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8408735d-55db-40d5-99e7-cb2b7cd8a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:54.410579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:54.460517 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 548/1085] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:54.752602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:54.755890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:54.900966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:54.914223 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce360e-a56c-41a6-ab46-2caba4ad9c2f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:55.038828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:55.039749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:55.040070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:55.040484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:55.042089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:55.143202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:55.144836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211354-36ab-40cd-ab36-623abe1a26b8 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:55.154902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:55.167812 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 538/1086] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:04.458136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=19 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:05.163782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:08.033878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249912-9ad9-4ec0-8765-c9e412a019dc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:08.034432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249912-9ad9-4ec0-8765-c9e412a019dc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:08.034432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249912-9ad9-4ec0-8765-c9e412a019dc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:08.036123 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 549/1087] 10.222.0.33 () {54 vars in 918 bytes} [Wed Oct 19 00:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:08.041931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339050-675d-4d7a-be91-392af015a650 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:08.042376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339050-675d-4d7a-be91-392af015a650 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:08.042472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339050-675d-4d7a-be91-392af015a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:08.117146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-56339050-675d-4d7a-be91-392af015a650 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:08.118342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-56339050-675d-4d7a-be91-392af015a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:08.222920 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 539/1088] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Oct 19 00:33:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:08.237705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801e0-f1d0-4d25-8aca-fe72c9e01e6e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:08.237987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801e0-f1d0-4d25-8aca-fe72c9e01e6e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:08.238254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801e0-f1d0-4d25-8aca-fe72c9e01e6e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:08.239560 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 550/1089] 10.222.0.33 () {54 vars in 918 bytes} [Wed Oct 19 00:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:08.244730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31940b-1617-4430-9aa5-ccd26eaf8c7d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:08.245006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31940b-1617-4430-9aa5-ccd26eaf8c7d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:08.245274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31940b-1617-4430-9aa5-ccd26eaf8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:08.317981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:08.321654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4c31940b-1617-4430-9aa5-ccd26eaf8c7d None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:08.323455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4c31940b-1617-4430-9aa5-ccd26eaf8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:08.438141 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 540/1090] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Oct 19 00:33:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:10.997691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:10.998241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:10.998241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:10.999619 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 551/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:11.004862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a6a0-6559-46e4-a254-2cd1c25c3905 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:11.005262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a6a0-6559-46e4-a254-2cd1c25c3905 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:11.005403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a6a0-6559-46e4-a254-2cd1c25c3905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:11.070691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5b08a6a0-6559-46e4-a254-2cd1c25c3905 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:11.071924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5b08a6a0-6559-46e4-a254-2cd1c25c3905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:11.126478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:11.168628 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 541/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:11.455546 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:11.457204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:11.602271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb810db0-1759-4d3c-8061-e9e3f0eb51cf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:11.677729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:11.718988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:11.719514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:11.719790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:11.720115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:11.721702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:11.811393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:11.812992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a3c3-80be-4354-bc97-8d56729e65bf service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:11.830768 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 552/1093] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:12.974986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:12.976076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:12.976076 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:12.977440 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 542/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:12.984004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bc11-75b8-4630-8a22-e8623bfab60b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:12.984466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bc11-75b8-4630-8a22-e8623bfab60b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:12.984660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bc11-75b8-4630-8a22-e8623bfab60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:13.064215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-adb0bc11-75b8-4630-8a22-e8623bfab60b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:13.065460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-adb0bc11-75b8-4630-8a22-e8623bfab60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:13.095180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:13.166420 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 553/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:13.317322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:13.320009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:13.466595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3db881-3ebe-47d2-808d-7c17bc9093e6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:13.505921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:13.579400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:13.580002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:13.580278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:13.580554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:13.582116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:13.669875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:13.671459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c331-6c33-42af-9644-6f5f59ce755a service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:13.689604 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 543/1096] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:14.812446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:14.813013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:14.813013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:14.814339 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 554/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:14.821104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6da5-3ff9-4974-a7a6-0d49fd0653a8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:14.821533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6da5-3ff9-4974-a7a6-0d49fd0653a8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:14.821654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6da5-3ff9-4974-a7a6-0d49fd0653a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:14.875947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:14.899963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-972d6da5-3ff9-4974-a7a6-0d49fd0653a8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:14.901195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-972d6da5-3ff9-4974-a7a6-0d49fd0653a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:14.995158 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 544/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:15.145094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:15.146518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:15.294847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1665-5385-4881-b5e3-ba6ee8a76031 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:15.307121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:15.408896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:15.409410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:15.409680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:15.409940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:15.411530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:15.499478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:15.501101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e455843-b14c-4e8c-80c7-12238fec5091 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:15.519308 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 555/1099] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:16.639730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:16.640266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:16.640377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:16.641634 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 545/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:16.647902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cbcba-48f2-4a2f-a70c-ec9b5cf10807 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:16.648337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cbcba-48f2-4a2f-a70c-ec9b5cf10807 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:16.648432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cbcba-48f2-4a2f-a70c-ec9b5cf10807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:16.669065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:16.724531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-949cbcba-48f2-4a2f-a70c-ec9b5cf10807 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:16.725723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-949cbcba-48f2-4a2f-a70c-ec9b5cf10807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:16.820577 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 556/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:16.971500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:16.972956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:17.088415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:17.124398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e75bc-4afa-446b-a63c-b1f0f6e2b59c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:17.238049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:17.238589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:17.238867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:17.239136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:17.240760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:17.318627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:17.333267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:17.334896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845f68-d5d2-43f5-8274-f5cb09f340df service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:17.352678 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 546/1102] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:18.465328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:18.465898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:18.465898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:18.467186 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 557/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:18.473456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d41a-28f3-4156-8b7e-600521a24ce4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:18.473866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d41a-28f3-4156-8b7e-600521a24ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:18.474008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d41a-28f3-4156-8b7e-600521a24ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:18.549691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-49d7d41a-28f3-4156-8b7e-600521a24ce4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:18.550935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-49d7d41a-28f3-4156-8b7e-600521a24ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:18.654913 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 547/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:18.804668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:18.806704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:18.896029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:18.959210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf499-1fb5-4371-ac7e-045f2e013663 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:19.074720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:19.075236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:19.075515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:19.075784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:19.077402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:19.126134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:19.167906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:19.169483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2134c-3c19-4ab5-b751-430bbcb59edb service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:19.186787 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 558/1105] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:20.236195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ba66-40b9-48de-8990-946ad79370db None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:20.236729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ba66-40b9-48de-8990-946ad79370db None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:20.236729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ba66-40b9-48de-8990-946ad79370db None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:20.237981 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 548/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:20.245011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40c59-9711-4ea3-ae01-19ce64c2b0b6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:20.245455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40c59-9711-4ea3-ae01-19ce64c2b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:20.245567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40c59-9711-4ea3-ae01-19ce64c2b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:20.324090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-65b40c59-9711-4ea3-ae01-19ce64c2b0b6 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:20.325281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-65b40c59-9711-4ea3-ae01-19ce64c2b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:20.423331 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 559/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:20.576864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098ba66-40b9-48de-8990-946ad79370db None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:20.578387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b098ba66-40b9-48de-8990-946ad79370db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:20.629732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:20.731956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098ba66-40b9-48de-8990-946ad79370db None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:20.842543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:20.843087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:20.843367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:20.843626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:20.845227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:20.852626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:20.935813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:20.937451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833daf-71b4-4b39-b8a8-7cc3483b1a8a service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:20.955193 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 549/1108] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:22.014506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:22.015034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:22.015034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:22.016328 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 560/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:22.022422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90429-7729-49ac-a48e-d17d055c6e70 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:22.022876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90429-7729-49ac-a48e-d17d055c6e70 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:22.022982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90429-7729-49ac-a48e-d17d055c6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:22.099336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c2c90429-7729-49ac-a48e-d17d055c6e70 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:22.100548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c2c90429-7729-49ac-a48e-d17d055c6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:22.170108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:22.200875 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 550/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:22.351198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:22.352905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:22.370939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:22.498632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc98668-6959-4bef-9fcb-5bbc9e209b13 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:22.585488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:22.612216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:22.612949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:22.613229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:22.613498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:22.615116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:22.706053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:22.707634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983b6a-7313-40d4-bf15-9087d13dbff2 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:22.725605 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 561/1111] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:23.775556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:23.776153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:23.776153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:23.777473 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 551/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:23.783601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4dca-3e3f-4fb4-ad6f-9cd37577e321 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:23.784016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4dca-3e3f-4fb4-ad6f-9cd37577e321 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:23.784180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4dca-3e3f-4fb4-ad6f-9cd37577e321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:23.861874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-10ea4dca-3e3f-4fb4-ad6f-9cd37577e321 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:23.863100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-10ea4dca-3e3f-4fb4-ad6f-9cd37577e321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:23.905157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:23.959009 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 562/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:24.109817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:24.111330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:24.258850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763f241-684e-49b8-a333-70fdb952d23a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:24.313646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:24.373952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:24.374553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:24.374829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:24.375097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:24.376718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:24.466667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:24.468324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f336d-112e-49b3-bbcd-d4432a547be9 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:24.486115 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 552/1114] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:25.546425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:25.546993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:25.546993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:25.548362 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 563/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:25.554633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e319-2c7e-444a-9149-9cfda390d6a0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:25.555687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e319-2c7e-444a-9149-9cfda390d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:25.555929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e319-2c7e-444a-9149-9cfda390d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:25.634657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7ea8e319-2c7e-444a-9149-9cfda390d6a0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:25.635869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7ea8e319-2c7e-444a-9149-9cfda390d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:25.637855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:25.731498 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 553/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:25.879678 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:25.881132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:26.027800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea915829-c99e-4f0e-8c87-5d97ad150ae1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:26.054894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:26.141848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:26.142345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:26.142614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:26.142875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:26.144496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:26.235414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:26.237015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6de939-1615-470d-87a3-e850898788a3 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:26.255015 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 564/1117] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:28.351006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:28.351525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:28.351622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:28.353712 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 554/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:28.359520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b55-0915-41c4-9fe4-a288d6dbec35 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:28.359992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b55-0915-41c4-9fe4-a288d6dbec35 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:28.360121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b55-0915-41c4-9fe4-a288d6dbec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:28.400593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:28.425896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6e0b3b55-0915-41c4-9fe4-a288d6dbec35 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:28.427095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6e0b3b55-0915-41c4-9fe4-a288d6dbec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:28.523467 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 565/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:28.806226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:28.807896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:28.911701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66252f7-eb5e-4158-a04a-22d229ddd4da None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:28.943746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:28.985808 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:28.986401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:28.986675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:28.986943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:28.988558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:29.097023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:29.098440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840a127-5a43-4500-a32d-8e9e30425885 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:29.116461 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 555/1120] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:31.404366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:31.404957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:31.404957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:31.406252 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 566/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:31.411539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b311c2-8ba2-4295-ae51-c711fa8dcf84 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:31.411976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b311c2-8ba2-4295-ae51-c711fa8dcf84 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:31.412119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b311c2-8ba2-4295-ae51-c711fa8dcf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:31.478063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-64b311c2-8ba2-4295-ae51-c711fa8dcf84 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:31.479939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-64b311c2-8ba2-4295-ae51-c711fa8dcf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:31.492938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:31.576879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 556/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:31.870100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:31.871646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:31.974541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd4753-dcef-4aa2-90af-851d89449221 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:31.987799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:32.050616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:32.051207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:32.051481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:32.051749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:32.053373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:32.161871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:32.163222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49f548-12e7-48d3-aacb-be83a8e5bcb7 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:32.181117 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 567/1123] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:34.643500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:34.644037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:34.644133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:34.645427 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 557/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:34.651437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257982-139f-4d77-8422-008a8cd7f58e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:34.651893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257982-139f-4d77-8422-008a8cd7f58e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:34.652024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257982-139f-4d77-8422-008a8cd7f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:34.700836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:34.718844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-76257982-139f-4d77-8422-008a8cd7f58e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:34.720078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-76257982-139f-4d77-8422-008a8cd7f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:34.816353 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 568/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:35.109664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:35.111198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:35.212136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b045b-5801-4b29-83bf-509f5dfc9672 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:35.252834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:35.287990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:35.288588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:35.288866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:35.289136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:35.290795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:35.399714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:35.401686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2550d6-3cf3-4a7a-98b0-5c98b7358627 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:35.419312 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 558/1126] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:37.696754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:37.697460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:37.697671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:37.699062 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 569/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:37.704302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7951cd-dc55-4e0f-8515-6efa0650871b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:37.704708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7951cd-dc55-4e0f-8515-6efa0650871b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:37.704847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7951cd-dc55-4e0f-8515-6efa0650871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:37.770204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2f7951cd-dc55-4e0f-8515-6efa0650871b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:37.771403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f7951cd-dc55-4e0f-8515-6efa0650871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:37.792018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:37.868433 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 559/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:38.159906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:38.161440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:38.266148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c49c-4d8a-46fb-8d7f-9cf744a66fd3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:38.288165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:38.352383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:38.352985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:38.353301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:38.353660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:38.355614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:38.467488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:38.468871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b37f-3cdf-447e-8bf8-78ae821d63e1 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:38.487134 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 570/1129] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:40.701644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:40.702236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:40.702236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:40.703520 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 560/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:40.708918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec16-ec54-440c-8309-4b7240239cb3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:40.709323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec16-ec54-440c-8309-4b7240239cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:40.709488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec16-ec54-440c-8309-4b7240239cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:40.772709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:40.776110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4cd3ec16-ec54-440c-8309-4b7240239cb3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:40.777586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4cd3ec16-ec54-440c-8309-4b7240239cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:40.874205 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 571/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:41.166550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:41.168168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:41.269921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73ba6d-1e22-46d7-8bbd-9e57ef3dc2dd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:41.318736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:41.345170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:41.345769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:41.346045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:41.346314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:41.347975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:41.455109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:41.456497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f61577-70be-45f4-a14f-edf769dab989 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:41.474518 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 561/1132] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:43.665161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:43.665747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:43.666006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:43.667701 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 572/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:43.673174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae101c-1b81-46de-982f-6c77275c636e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:43.673597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae101c-1b81-46de-982f-6c77275c636e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:43.673727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae101c-1b81-46de-982f-6c77275c636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:43.740746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1cae101c-1b81-46de-982f-6c77275c636e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:43.741946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1cae101c-1b81-46de-982f-6c77275c636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:43.771157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:43.839801 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 562/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:44.124095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:44.125616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:44.231597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50a9dc-6de5-4b3d-8418-14e96e2b1472 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:44.262569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:44.309259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:44.309859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:44.310138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:44.310411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:44.312053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:44.422682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:44.424063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c331fd-0cef-4d4f-8152-bc658ecd1d26 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:44.442375 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 573/1135] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:46.645041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:46.645532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:46.645636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:46.646977 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:46.653447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a76c-da8d-429e-ac1e-f4fccfa33fa2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:46.653874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a76c-da8d-429e-ac1e-f4fccfa33fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:46.653981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a76c-da8d-429e-ac1e-f4fccfa33fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:46.719973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0b38a76c-da8d-429e-ac1e-f4fccfa33fa2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:46.721194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0b38a76c-da8d-429e-ac1e-f4fccfa33fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:46.730208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:46.817574 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:47.101043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:47.102592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:47.205589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa47cb-b916-4bb0-8a4c-c7839ed22cdb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:47.261221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:47.279785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:47.280413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:47.280691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:47.280964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:47.282559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:47.392130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:47.393486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a488ba-92b1-4f24-8aa2-cb637663fe4a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:47.411762 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 564/1138] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:49.657730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:49.658298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:49.658298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:49.659643 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:49.665022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8452-335a-44b6-a0bc-bca3fd833b0b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:49.665995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8452-335a-44b6-a0bc-bca3fd833b0b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:49.665995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8452-335a-44b6-a0bc-bca3fd833b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:49.730474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-09ba8452-335a-44b6-a0bc-bca3fd833b0b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:49.731659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-09ba8452-335a-44b6-a0bc-bca3fd833b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:49.769601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:49.827097 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:50.111795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:50.113421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:50.217141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea90f8-1254-4a05-bb68-a145aeab0811 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:50.254925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:50.292663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:50.293261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:50.293539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:50.293811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:50.295413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:50.406969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:50.408446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da870ab7-cbaa-4dcd-b811-6e8f4585315f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:50.426038 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 576/1141] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:52.595531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:52.596079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:52.596079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:52.597469 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:52.603333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379428-7019-4f70-ace9-84461b85b92d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:52.603777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379428-7019-4f70-ace9-84461b85b92d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:52.603905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379428-7019-4f70-ace9-84461b85b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:52.671518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5a379428-7019-4f70-ace9-84461b85b92d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:52.672745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5a379428-7019-4f70-ace9-84461b85b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:52.691119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:52.768857 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:53.055002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:53.056687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:53.158334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bbc19-b874-46db-8005-30e0654fcaa3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:53.225590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:53.232952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:53.233811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:53.234082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:53.234347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:53.235954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:53.343261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:53.344736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f305-cb88-43b3-b29b-e1279500c20b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:53.363168 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 567/1144] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:55.512620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:55.513195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:55.513195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:55.514539 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:55.519925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968141-eb2c-4bcd-801c-50b72f1be996 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:55.520363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968141-eb2c-4bcd-801c-50b72f1be996 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:55.520461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968141-eb2c-4bcd-801c-50b72f1be996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:55.585945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e0968141-eb2c-4bcd-801c-50b72f1be996 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:55.587289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e0968141-eb2c-4bcd-801c-50b72f1be996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:55.637325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:55.687470 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:55.969236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:55.970781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:56.073876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38fed-b84f-451d-b48e-23167e20de1c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:56.122768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:56.148328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:56.148943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:56.149212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:56.150471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:56.152070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:56.262183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:56.263529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608c7a-24c4-447d-af9a-2cb520782216 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:56.281380 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 579/1147] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:05.685956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=22 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:06.279115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=66 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:16.485416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483af23-2867-49fd-8ce9-a489d5a95d44 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:16.485983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483af23-2867-49fd-8ce9-a489d5a95d44 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:16.485983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483af23-2867-49fd-8ce9-a489d5a95d44 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:16.487297 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 569/1148] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:16.493058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ca91-56ba-4e70-8dfd-d41a4655af1b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:16.493438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ca91-56ba-4e70-8dfd-d41a4655af1b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:16.493604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ca91-56ba-4e70-8dfd-d41a4655af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:16.559876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f371ca91-56ba-4e70-8dfd-d41a4655af1b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:16.561066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f371ca91-56ba-4e70-8dfd-d41a4655af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:16.659941 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 580/1149] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:16.960841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:16.961124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:16.961402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:16.962760 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 570/1150] 10.222.0.33 () {54 vars in 962 bytes} [Wed Oct 19 00:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:16.967765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2251-4868-4fe5-801e-1414c4c080d0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:16.968106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2251-4868-4fe5-801e-1414c4c080d0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:16.968374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2251-4868-4fe5-801e-1414c4c080d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:17.044110 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-aafc2251-4868-4fe5-801e-1414c4c080d0 None None] MFA Rules not processed for user `6b298c229b7f402c9883e743c82110a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:17.045287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aafc2251-4868-4fe5-801e-1414c4c080d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:17.065917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:17.120856 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 581/1151] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Oct 19 00:34:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:17.128588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:17.130091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:17.232259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1349-a4e2-46be-ad74-998736e83dd2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:17.307424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:17.308050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:17.308325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:17.308590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:17.310156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:17.363291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:17.417534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:17.419078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf41fc-d423-4036-86ed-fabdaf1bafde service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:17.438132 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 571/1152] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:19.682661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.683250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.683250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.684601 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 582/1153] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:19.689931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a11e5-7286-4152-9bd4-1e1036f1ac8f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.690369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a11e5-7286-4152-9bd4-1e1036f1ac8f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.690516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a11e5-7286-4152-9bd4-1e1036f1ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.756290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8b8a11e5-7286-4152-9bd4-1e1036f1ac8f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:19.757487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8b8a11e5-7286-4152-9bd4-1e1036f1ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:19.853001 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 572/1154] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:20.125579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:20.127107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:20.252492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dcdb6-4b3b-4750-9d8c-cb67a0ccdd3f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:20.303830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:20.349307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:20.349903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:20.350174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:20.350440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:20.351095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:20.353057 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:34:20.353057 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:34:20.353057 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:34:20.354172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73e714-db3b-45e4-8837-9e4e7528e49a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:20.374228 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 583/1155] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Oct 19 00:34:20 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:34:22.553164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:22.553716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:22.553716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:22.555786 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 573/1156] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:22.561148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c3e9-5d35-46e5-bbff-9cc260a5158c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:22.561552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c3e9-5d35-46e5-bbff-9cc260a5158c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:22.561685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c3e9-5d35-46e5-bbff-9cc260a5158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:22.629716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fb32c3e9-5d35-46e5-bbff-9cc260a5158c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:22.630911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fb32c3e9-5d35-46e5-bbff-9cc260a5158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:22.728183 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 584/1157] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:23.024099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:23.025741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:23.035688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.171334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e0628-6d8f-4cf5-b342-7459f42dee5d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:23.250065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.282919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:23.283507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:23.283776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:23.284070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:23.285636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:23.375441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:23.377061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29b36-1e07-4840-a362-788ea619a821 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:23.394537 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 574/1158] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:25.712131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:25.712723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:25.712723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:25.714002 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 585/1159] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:25.719300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5730-53de-4b20-b66a-b9786ca027cd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:25.719801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5730-53de-4b20-b66a-b9786ca027cd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:25.719956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5730-53de-4b20-b66a-b9786ca027cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:25.784877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bf1d5730-53de-4b20-b66a-b9786ca027cd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:25.786072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bf1d5730-53de-4b20-b66a-b9786ca027cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:25.831899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:25.883322 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 575/1160] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:26.169612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:26.171147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:26.196799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:26.276636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b65ab-adcf-4431-b01e-610d4b906d32 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:26.349787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:26.350388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:26.350664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:26.350931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:26.353204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:26.429259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:26.465138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:26.466956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181428c-3850-483e-9afe-edff26c596ed service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:26.485149 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 586/1161] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:28.684712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:28.685235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:28.685235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:28.686610 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 576/1162] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:28.691907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63edc-8437-4a66-84ad-8e469841d336 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:28.692367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63edc-8437-4a66-84ad-8e469841d336 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:28.692470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63edc-8437-4a66-84ad-8e469841d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:28.758918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1ff63edc-8437-4a66-84ad-8e469841d336 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:28.760124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1ff63edc-8437-4a66-84ad-8e469841d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:28.855157 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 587/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:29.151738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:29.153358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:29.256837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c249-2242-4bdf-babc-811461403e32 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:29.328786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:29.330241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:29.330841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:29.331318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:29.331756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:29.333557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:29.443256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:29.445132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544dd0-43b0-44f6-a98e-611e3c749ada service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:29.466137 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 577/1164] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:31.707786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:31.708360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:31.708360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:31.709731 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 588/1165] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:31.715627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca7d6-090b-490b-830b-1f852067244c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:31.716102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca7d6-090b-490b-830b-1f852067244c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:31.716213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca7d6-090b-490b-830b-1f852067244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:31.781951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-824ca7d6-090b-490b-830b-1f852067244c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:31.783148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-824ca7d6-090b-490b-830b-1f852067244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:31.835034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:31.879699 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 578/1166] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:32.169501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:32.171086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:32.206391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:32.275951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b40e8-68fa-465f-8bfc-81d8e96d7b49 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:32.350985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:32.351649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:32.351980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:32.352272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:32.353778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:32.435299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:32.466840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:32.468328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929f84-70c7-4e84-bc3b-a5c662e07c8b service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:32.486574 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 589/1167] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:34.809592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:34.810163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:34.810163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:34.811513 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 579/1168] 10.222.0.33 () {54 vars in 927 bytes} [Wed Oct 19 00:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:34.816686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749db32b-501f-40e0-8627-d8c3a7715f83 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:34.817139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749db32b-501f-40e0-8627-d8c3a7715f83 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:34.817247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749db32b-501f-40e0-8627-d8c3a7715f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:34.884295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-749db32b-501f-40e0-8627-d8c3a7715f83 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:34.885423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-749db32b-501f-40e0-8627-d8c3a7715f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:34.984024 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 590/1169] 10.222.0.33 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:35.272413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:35.274549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:35.379156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6d29-24ca-409f-b7e8-34072ab41f6d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:35.453100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:35.453715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.453989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.454254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.455826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:35.464327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:35.566264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:35.567689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df68a2a-9f15-4117-9935-cecf8082ab2f service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:35.585571 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 580/1170] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:44.982338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=82 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:45.583267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=50 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:49.392713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:49.393309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:49.393309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:49.469676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:49.470866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:49.568015 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 591/1171] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:49.575813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:49.576341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:49.576457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:49.653834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:49.654976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:49.750824 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 581/1172] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:49.755335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:49.756576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:49.767959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73287f01-f2b8-4667-bd32-037d6e15a99a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:49.830619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:49.864964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:49.865568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:49.865848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:49.866114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:49.866746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:35:49.867044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:49.868226 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:49.868226 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:35:49.868226 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:35:49.869116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:49.881194 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 592/1173] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:35:49.890602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:49.900620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541841ea-98b0-42cc-b6f2-0ca8b676eed1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:49.965172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:49.999709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.000328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.000599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.000865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.001482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.002498 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:50.002498 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:35:50.002498 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:35:50.003671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.060893 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 582/1174] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:35:49 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:35:50.065041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:50.066550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.100083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5505-bc17-4cc3-bd09-344b87a8cf7c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:50.191149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.191659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.191957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.192225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.193530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.194536 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:50.194536 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:35:50.194536 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:35:50.195724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.237362 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 593/1175] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:35:50 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:35:50.241876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:50.243441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.305426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f77ac-7d71-49e1-8595-a80f57442abf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:50.389837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:50.402460 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.403058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.403327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.403586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.404245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.405826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.417902 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 583/1176] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:50.421982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:50.423552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.434936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5b4b-f396-4397-9728-56dcbe8f2758 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:50.461181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:50.532310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.532907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.533181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.533447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.534077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.535658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c21d-1c9d-4878-b106-7109a5f5b587 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.548163 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 594/1177] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:50.552451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:50.553955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.590207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15823e-4b97-4cd5-8b8d-cab5cfe7998c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:50.691568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.692253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.693099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.693375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] PATH_INFO: `/v3/projects/5a9853c6e7c543b2b9d334ccdb938f04/users/99eeed115a5d4f1193e007ad18d13d71/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.716380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9853c6e7c543b2b9d334ccdb938f04, user_id=99eeed115a5d4f1193e007ad18d13d71, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.717378 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:50.717378 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:35:50.717378 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:35:50.719364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29704271-3190-4132-9ffd-535ca50647f5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.745507 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 584/1178] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:50 2022] PUT /identity/v3/projects/5a9853c6e7c543b2b9d334ccdb938f04/users/99eeed115a5d4f1193e007ad18d13d71/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:35:50.757577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0493-0d12-4dbc-8222-d69341c4827e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.757864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0493-0d12-4dbc-8222-d69341c4827e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.758133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0493-0d12-4dbc-8222-d69341c4827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.815453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6c3d0493-0d12-4dbc-8222-d69341c4827e None None] MFA Rules not processed for user `99eeed115a5d4f1193e007ad18d13d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:50.816683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c3d0493-0d12-4dbc-8222-d69341c4827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.896145 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 595/1179] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:35:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:50.909346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.909630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.909925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.911323 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 585/1180] 10.222.0.33 () {54 vars in 963 bytes} [Wed Oct 19 00:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:50.916304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2a23-5f45-4fea-89a6-5f8b6d66ebb1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.916594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2a23-5f45-4fea-89a6-5f8b6d66ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.916866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2a23-5f45-4fea-89a6-5f8b6d66ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.949101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:50.994459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d4ae2a23-5f45-4fea-89a6-5f8b6d66ebb1 None None] MFA Rules not processed for user `8b209bd7afbd44ceabe2d9b71e7585e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:50.995590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d4ae2a23-5f45-4fea-89a6-5f8b6d66ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:51.071650 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 596/1181] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Oct 19 00:35:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:51.079414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:51.080966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:51.131949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:51.186201 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9b2b-0ba1-46df-a50c-d68425c047c5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:51.258667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:51.259185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:51.259460 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:51.259730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:51.261334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:51.360216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:51.361650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:51.365114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:51.380596 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 586/1182] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:51.425735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116db7a-f08e-4ed6-a4cc-a964bfd93535 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:51.426187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116db7a-f08e-4ed6-a4cc-a964bfd93535 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:51.426297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116db7a-f08e-4ed6-a4cc-a964bfd93535 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:51.427612 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 597/1183] 10.222.0.33 () {52 vars in 830 bytes} [Wed Oct 19 00:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:51.431134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:51.432375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:51.529165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169bc8e-a724-49cb-ad98-26711be0beb2 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:51.622944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:51.623566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:51.623837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:51.624130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] PATH_INFO: `/v3/users/99eeed115a5d4f1193e007ad18d13d71` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:51.636944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99eeed115a5d4f1193e007ad18d13d71)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:51.637967 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:51.637967 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:35:51.637967 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:35:51.639154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:51.649188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:51.703886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99eeed115a5d4f1193e007ad18d13d71'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:51.704329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99eeed115a5d4f1193e007ad18d13d71'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:51.714468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99eeed115a5d4f1193e007ad18d13d71'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:51.738310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99eeed115a5d4f1193e007ad18d13d71'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:51.738886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99eeed115a5d4f1193e007ad18d13d71'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:51.758847 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 587/1184] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:35:51 2022] DELETE /identity/v3/users/99eeed115a5d4f1193e007ad18d13d71 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:35:51.763306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:51.763595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:51.763893 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:51.821814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:51.822933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:51.898757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:51.911625 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 598/1185] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:51.921479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:51.922693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.024280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03cca-22c5-41d2-9f0a-0f3037d4112c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.078656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:52.099353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.099982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.100259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.100526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.102117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.209708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a25d88-5746-4e61-9711-7856c0b024f9 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.229069 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 588/1186] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:52.577984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.579442 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.590877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a349c78-30bf-43a7-a4ae-3bf47fc35010 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.693419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.694054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.694334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.694604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] PATH_INFO: `/v3/projects/5a9853c6e7c543b2b9d334ccdb938f04` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.704767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9853c6e7c543b2b9d334ccdb938f04)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.705796 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:52.705796 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:35:52.705796 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:35:52.706999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.766447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9853c6e7c543b2b9d334ccdb938f04', 'request_id': 'req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:52.772517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9853c6e7c543b2b9d334ccdb938f04', 'request_id': 'req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:52.786610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9853c6e7c543b2b9d334ccdb938f04', 'request_id': 'req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:52.814210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] The token cache is being invalidate because project 5a9853c6e7c543b2b9d334ccdb938f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:35:52.814494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:52.814912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c15a0f60-3e9a-481f-9add-4e7a8e45ad05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:35:52.816317 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 599/1187] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:35:52 2022] DELETE /identity/v3/projects/5a9853c6e7c543b2b9d334ccdb938f04 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:36:02.226838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=62 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:02.812187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:25.582282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:25.582922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:25.582922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:25.584230 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 589/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:25.590168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326ddc-1f1a-46ea-9098-25a532727efe None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:25.590588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326ddc-1f1a-46ea-9098-25a532727efe None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:25.590705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326ddc-1f1a-46ea-9098-25a532727efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:25.673155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d9326ddc-1f1a-46ea-9098-25a532727efe None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:25.674359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d9326ddc-1f1a-46ea-9098-25a532727efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:25.778433 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 600/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:25.934010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:25.936216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:26.052916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0ec87-fe8a-4ddc-86bf-0d7f9d41ca89 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:26.059245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:26.059832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:26.060139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:26.060407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:26.068467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:26.070718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb5bb-5616-42db-b454-7c012d60b384 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:26.080085 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 590/1190] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:27.178802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a9fa-fa81-4c7b-81b6-0ded56819ada None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:27.179379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a9fa-fa81-4c7b-81b6-0ded56819ada None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:27.179379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a9fa-fa81-4c7b-81b6-0ded56819ada None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:27.181720 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 601/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:27.188052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47dc62-5a27-4244-bf85-73a0df4d33a3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:27.188490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47dc62-5a27-4244-bf85-73a0df4d33a3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:27.188625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47dc62-5a27-4244-bf85-73a0df4d33a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:27.207705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4f47dc62-5a27-4244-bf85-73a0df4d33a3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:27.208936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4f47dc62-5a27-4244-bf85-73a0df4d33a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:27.217371 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 591/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:27.317692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15eea9-15f7-4892-ba07-2a73bbb62729 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:27.317978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15eea9-15f7-4892-ba07-2a73bbb62729 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:27.318255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15eea9-15f7-4892-ba07-2a73bbb62729 None None] PATH_INFO: `/v3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:27.319522 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 602/1193] 10.222.0.18 () {54 vars in 925 bytes} [Wed Oct 19 00:37:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:37:27.326090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46103-804d-4f48-81f1-0f879ece8ec3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:27.326380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46103-804d-4f48-81f1-0f879ece8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:27.326652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46103-804d-4f48-81f1-0f879ece8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:27.370858 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15eea9-15f7-4892-ba07-2a73bbb62729 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:27.385947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15eea9-15f7-4892-ba07-2a73bbb62729 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:27.388008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-21c46103-804d-4f48-81f1-0f879ece8ec3 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:27.389200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-21c46103-804d-4f48-81f1-0f879ece8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:27.391594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:27.392219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:27.392496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:27.392760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:27.401626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:27.403212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9e1f-fccb-40bc-a06e-dc31daaa34d6 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:27.412467 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 603/1194] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:37:27.444645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:27.466674 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 592/1195] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 19 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:36.085861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467643f-30ba-49d2-b950-92da67ecd732 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:36.086316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467643f-30ba-49d2-b950-92da67ecd732 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:36.086413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467643f-30ba-49d2-b950-92da67ecd732 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:36.087905 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 604/1196] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:36.093292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045100-aecd-462c-8a8b-d9f51147aa28 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:36.093730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045100-aecd-462c-8a8b-d9f51147aa28 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:36.093828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045100-aecd-462c-8a8b-d9f51147aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:36.114616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-65045100-aecd-462c-8a8b-d9f51147aa28 None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:36.115833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-65045100-aecd-462c-8a8b-d9f51147aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:36.125063 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 593/1197] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:36.132526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467643f-30ba-49d2-b950-92da67ecd732 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:36.145830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467643f-30ba-49d2-b950-92da67ecd732 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:36.150837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:36.151430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:36.151689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:36.151998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:36.160041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:36.161603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34faea-cb88-466c-aff9-a40e3d6cc648 service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:36.171490 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 605/1198] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:38.883545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403584-aa96-478a-b9f3-77ac58f9506d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:38.884452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403584-aa96-478a-b9f3-77ac58f9506d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:38.884731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403584-aa96-478a-b9f3-77ac58f9506d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:38.886115 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 594/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:38.892364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2555-79a5-4204-b0be-b2dfe4e26cd2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:38.892814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2555-79a5-4204-b0be-b2dfe4e26cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:38.892921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2555-79a5-4204-b0be-b2dfe4e26cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:38.912926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f78c2555-79a5-4204-b0be-b2dfe4e26cd2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:38.914145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f78c2555-79a5-4204-b0be-b2dfe4e26cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:38.922801 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 606/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:39.076465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403584-aa96-478a-b9f3-77ac58f9506d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:39.091455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403584-aa96-478a-b9f3-77ac58f9506d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:39.096916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:39.097508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:39.097787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:39.098058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:39.106775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:39.108688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef771a-0a17-4fab-ab1f-b75cefeb7f2c service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:39.117878 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 595/1201] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:40.187669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860763-ba4a-4c31-acf6-4d561692cc5e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:40.188281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860763-ba4a-4c31-acf6-4d561692cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:40.188281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860763-ba4a-4c31-acf6-4d561692cc5e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:40.189594 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 607/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:40.195644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13207-493a-490b-a3d2-93001cf6c725 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:40.196100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13207-493a-490b-a3d2-93001cf6c725 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:40.196275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13207-493a-490b-a3d2-93001cf6c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:40.215700 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a5c13207-493a-490b-a3d2-93001cf6c725 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:40.216943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a5c13207-493a-490b-a3d2-93001cf6c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:40.224946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 596/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:40.377258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860763-ba4a-4c31-acf6-4d561692cc5e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:40.391962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860763-ba4a-4c31-acf6-4d561692cc5e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:40.397312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:40.397894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:40.398169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:40.398438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:40.406845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:40.408472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117df0-5ff8-4faa-bff1-04f5b6c829aa service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:40.417593 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 608/1204] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:44.341128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:44.341727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:44.341727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:44.343070 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 597/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:44.348572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a517f-9646-4161-b34e-5b40f312299b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:44.349056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a517f-9646-4161-b34e-5b40f312299b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:44.349165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a517f-9646-4161-b34e-5b40f312299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:44.369985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-be7a517f-9646-4161-b34e-5b40f312299b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:44.371175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be7a517f-9646-4161-b34e-5b40f312299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:44.379069 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 609/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:37:44.673910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:44.675625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:44.753085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e785fa-fdcd-47a1-80ce-c338824f1eb8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:44.756588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:44.757177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:44.757450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:44.757716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:44.767075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:44.768541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147119bb-780d-439b-a917-a2690b610575 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:44.777714 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 598/1207] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:46.919395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:46.919998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:46.919998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:46.921338 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 610/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:46.926707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1334fd5-2c8d-47e4-834d-09706620eac5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:46.927122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1334fd5-2c8d-47e4-834d-09706620eac5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:46.927309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1334fd5-2c8d-47e4-834d-09706620eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:46.947759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f1334fd5-2c8d-47e4-834d-09706620eac5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:46.949034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f1334fd5-2c8d-47e4-834d-09706620eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:46.956901 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 599/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:47.242778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:47.245221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:47.257886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda86e-76f1-43c0-b306-fbfedaed9571 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:47.261631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:47.262211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:47.262484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:47.262749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:47.271383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:47.272821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b171b-d439-4edb-87f7-d08adf37bad8 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:47.281942 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 611/1210] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:50.922265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:50.922830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:50.922830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:50.924301 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 600/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:50.929375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e102a-83ab-4638-a614-679c7cf15dad None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:50.929810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e102a-83ab-4638-a614-679c7cf15dad None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:50.929908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e102a-83ab-4638-a614-679c7cf15dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:50.937597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:50.952559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6b9e102a-83ab-4638-a614-679c7cf15dad None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:50.953758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6b9e102a-83ab-4638-a614-679c7cf15dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:50.962251 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 612/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:37:51.264640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:51.266403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:51.343492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74dc63-1955-4715-9ede-4f53c0727887 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:51.347055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:51.347647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:51.347955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:51.348227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:51.357082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:51.358756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c7446-e13f-40ee-8329-cc959ec39f24 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:51.368536 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 601/1213] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:53.503506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:53.504108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:53.504108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:53.505410 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 613/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:37:53.510780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfbf7-41ba-4663-a8c0-a10cb62fef62 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:53.511200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfbf7-41ba-4663-a8c0-a10cb62fef62 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:53.511315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfbf7-41ba-4663-a8c0-a10cb62fef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:53.531281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0b2cfbf7-41ba-4663-a8c0-a10cb62fef62 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:53.532492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0b2cfbf7-41ba-4663-a8c0-a10cb62fef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:53.541120 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 602/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:53.840004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:53.841641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:53.854130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff6456-01bc-4b16-be45-c6f74f70b48a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:53.857862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:53.858439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:53.858713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:53.858978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:53.867701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:53.869291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e2c34-ab62-4cb4-bf97-fe0874056e15 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:53.878784 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 614/1216] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:38:03.526480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:03.874547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:29.147315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f66a-ea39-45fe-8771-69bbfb851c48 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.154371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f66a-ea39-45fe-8771-69bbfb851c48 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.154371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f66a-ea39-45fe-8771-69bbfb851c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.180868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-16f4f66a-ea39-45fe-8771-69bbfb851c48 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.182084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-16f4f66a-ea39-45fe-8771-69bbfb851c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.188449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0899ac-bae4-43f5-a78f-1e698d468edf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.189423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0899ac-bae4-43f5-a78f-1e698d468edf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.190037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0899ac-bae4-43f5-a78f-1e698d468edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.195878 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 603/1217] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:29.204500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30b23-2003-4ca7-a224-f1a1a12bca8d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.204818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30b23-2003-4ca7-a224-f1a1a12bca8d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.205051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30b23-2003-4ca7-a224-f1a1a12bca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.217358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ac0899ac-bae4-43f5-a78f-1e698d468edf None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.219135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ac0899ac-bae4-43f5-a78f-1e698d468edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.234638 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 615/1218] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.235943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41768-b68a-4a2a-9d29-43cb6e4c4a9c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.236236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41768-b68a-4a2a-9d29-43cb6e4c4a9c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.236510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41768-b68a-4a2a-9d29-43cb6e4c4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.240944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5cd30b23-2003-4ca7-a224-f1a1a12bca8d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.242177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5cd30b23-2003-4ca7-a224-f1a1a12bca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.268896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8ac41768-b68a-4a2a-9d29-43cb6e4c4a9c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.270468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8ac41768-b68a-4a2a-9d29-43cb6e4c4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.281734 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 616/1219] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.283084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0831-b789-4ada-ba92-bdb305c0700a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.283373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0831-b789-4ada-ba92-bdb305c0700a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.283651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0831-b789-4ada-ba92-bdb305c0700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.285585 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 604/1220] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:29.286857 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.287139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.287408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.310691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-301a0831-b789-4ada-ba92-bdb305c0700a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.313316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-301a0831-b789-4ada-ba92-bdb305c0700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.338925 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 617/1221] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.340751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.340893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.341400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.341901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.342097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.367441 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 605/1222] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.368775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.379344 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.380597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.386593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb028-b5b0-4cfd-ae13-b04d4aad8401 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.389323 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 618/1223] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.391506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.398841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.399717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.401030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.401313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.401435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fbbfe-f858-446d-b247-eec8b026ea94 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.402033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.402274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.403301 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:39:29.403301 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:39:29.403301 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:39:29.404298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc2bfa-15ef-4491-8037-0565aad6b5d1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.407149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.407744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.408073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.408361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.408993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.409289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.410852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe5f92-bd4b-4b5c-af63-5b96c7254754 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.416681 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 606/1224] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.418056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d8de-c857-4190-8681-bee2f56f34ce None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.418553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d8de-c857-4190-8681-bee2f56f34ce None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.418834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d8de-c857-4190-8681-bee2f56f34ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.426051 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 619/1225] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.426051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2cd9-e9e8-4984-bf32-1b1905efb7b9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.426051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2cd9-e9e8-4984-bf32-1b1905efb7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.426051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2cd9-e9e8-4984-bf32-1b1905efb7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.439162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9ab5d8de-c857-4190-8681-bee2f56f34ce None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.440428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9ab5d8de-c857-4190-8681-bee2f56f34ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.445288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e4ff2cd9-e9e8-4984-bf32-1b1905efb7b9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.446458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e4ff2cd9-e9e8-4984-bf32-1b1905efb7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.448881 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 607/1226] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.450288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.450585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.450834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.455585 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 620/1227] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.456752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163802-270f-4725-ae6f-373b391d68e2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.457045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163802-270f-4725-ae6f-373b391d68e2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.457321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163802-270f-4725-ae6f-373b391d68e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.475339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.476576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.476715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-78163802-270f-4725-ae6f-373b391d68e2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.477851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-78163802-270f-4725-ae6f-373b391d68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.484675 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 608/1228] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.485477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.486753 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 621/1229] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.489180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.490079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.490692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.495043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3d679-4865-493a-88a1-09ea926db252 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.500456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.501044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.501323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.501595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.502231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.502529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.504193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.510961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.512166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.516440 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 609/1230] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.516440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.524947 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 622/1231] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.525671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.529115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf10da-5284-4a96-b0c0-43986e4ab309 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.534169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.534771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.535052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.535327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.535433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b45e7-6e91-40cc-a385-64ec3b8dbe35 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.535989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.537962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea6c3-4ba8-43f3-99cd-7b286f457130 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.539762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.540498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.540777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.541048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.541692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.542689 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:39:29.542689 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:39:29.542689 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:39:29.543869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19506a9-f99e-451c-9853-d9d08380e4bf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.584854 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 610/1232] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.584854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.584854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.584854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.590665 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 623/1233] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.592198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f3b0-d0d2-4a52-a8d7-7c4c34472ad0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.593927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f3b0-d0d2-4a52-a8d7-7c4c34472ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.594218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f3b0-d0d2-4a52-a8d7-7c4c34472ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.605749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.606728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.618462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2e70f3b0-d0d2-4a52-a8d7-7c4c34472ad0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.619667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2e70f3b0-d0d2-4a52-a8d7-7c4c34472ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.682119 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 611/1234] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.682888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.690327 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 624/1235] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.692086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76154b-64d2-4b0d-a4d2-1630aa7d4582 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.692357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65542711-1ee1-4e9a-944e-4196028c948a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.692482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76154b-64d2-4b0d-a4d2-1630aa7d4582 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.692656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76154b-64d2-4b0d-a4d2-1630aa7d4582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.697459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.698196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.698480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.698755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.699397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.699887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.701488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.712660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dd76154b-64d2-4b0d-a4d2-1630aa7d4582 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.713874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dd76154b-64d2-4b0d-a4d2-1630aa7d4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.714839 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 612/1236] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.715475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.724243 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 625/1237] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.725572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.725862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.726142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.730055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff5cb7-3682-49ab-8857-3a793bd4f756 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.736630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.737227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.737507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.737776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.738405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.740349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.746577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:29.747784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:29.756673 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 626/1238] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:29.757443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.769289 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 613/1239] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.770102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.770257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a12c-318f-4635-af39-102c69ecaba9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.815457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:29.838054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:29.846384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.847811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.848221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.848508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.849167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.849601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af7ea-3726-413d-b48c-fbea3a3dd17d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.851766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.854865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.855578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.855996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.856371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.857137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.859354 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:39:29.859354 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:39:29.859354 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:39:29.860361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.875082 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 627/1240] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.875523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.885222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd30a4-8764-4ad2-849e-d18566b267cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.885891 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 614/1241] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.886747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.893253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.893938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.894225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.894494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.895138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.895438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.897070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.898731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edfbbc-893f-4d94-88bb-abcbb66ff11f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.903357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.904044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.904261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.904524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.905692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.906005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.907592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.910083 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 628/1242] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.912795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.920044 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 615/1243] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.921989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.924839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d630-c044-4b90-a74f-75dc6fc26137 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.929994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.930588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.930868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.931140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.931761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.931968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4fa7-9fbb-4521-be5f-b1cd0b8c57cf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.933732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.937477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:29.938063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:29.938336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:29.938597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:29.939222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:29.939505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:29.941171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:29.955677 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 616/1244] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:29.956753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:29.972068 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 629/1245] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:29.972277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9f4-6b01-4116-827c-d57e405d9b06 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:29.973627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.028098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.028709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.028991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.029262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.030491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:30.030796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.032431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.044153 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 617/1246] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:30.044946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.046434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf833439-2d6c-403b-9681-02b1a59ff1de admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.052375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.052786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.053073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.053353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.053983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.055092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd16c-751b-4697-a735-4720afd02dd0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.056059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.059684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.060300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.060595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.060870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.061529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.063102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.074778 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 618/1247] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.075601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.077924 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 630/1248] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:29 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.078707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.088437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ee34-893e-44a0-82b0-6958a8305103 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.088601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccbe-773f-407d-a788-54c04d667fd7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.093841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.094421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.094605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.094888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.095049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.095156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.095328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.095598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.095765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.096264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.097719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.097869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.107838 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 619/1249] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.109679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.119579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3bd8c-710b-42ec-bbe0-d3558b9864c0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.124787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.125367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.125664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.125918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.126539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.130332 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 631/1250] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.130332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.130608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.159941 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 620/1251] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.159941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.198212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7a47-fcf8-4f52-80d2-75e0140a964e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.206004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.222715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.223014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafeac0-ae89-4a02-9268-2d148a5feb7a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.228484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.229132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.229418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.229689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.230330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.232392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.257015 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 621/1252] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.257920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.259194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.259802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.260359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.260643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.261272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.263201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.269973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522931-dfc4-4a7a-9ce1-f34667d17412 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.274524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.275104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.275380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.275648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.276304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.278192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.290300 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 632/1253] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.291527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.312295 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 622/1254] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.313806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.356113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeedd9-2225-4d21-9d75-70d62db8bfde admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.377750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea181-7e76-49c5-b6c1-7cbcb22badf4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.382511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.383108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.383393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.383680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.384352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.385970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.395781 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 623/1255] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.396767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.406123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8335-981a-4a6b-8a6f-2d337ac79184 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.410967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.411482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.411762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.412066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.412685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.414278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.415516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.416201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.416478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.416745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.417384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.418961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.424896 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 624/1256] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.425744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.429622 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 633/1257] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.430443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.435817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef0d12-fecc-4fea-8b4c-7cfaee73437f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.440435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db01b-85c2-4279-9fd2-92fbd75188a0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.441280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.441865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.442142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.442411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.443033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.444974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.445233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.445799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.446078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.446347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.446963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.448884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.468874 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 625/1258] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.470153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.472666 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 634/1259] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.473653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.480187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438cd2-0ca8-4d43-ba20-a59ded5b90dc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.485532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb732f-095c-459a-b135-5842466fe2a3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.485851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.486440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.486728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.486995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.487624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.489287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.490198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.490777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.491056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.491327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.491976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.493852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.500144 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 626/1260] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.500784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.512863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c9ed-caff-4d0a-b24b-3db7315d148e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.517064 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 635/1261] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.518472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.519249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.519345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.519591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.520488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.520946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.522405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.530987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d54e-14ae-415f-a540-82a063ded078 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.536312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.536988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.537303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.537615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] PATH_INFO: `/v3/projects/5a230211180742ef9efd4d62b630d211/users/5628a861c90042d88b95f2d7b898ed52/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.544741 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 627/1262] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:30.546088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.555549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e35be-2bd0-4058-8994-91f3d5523f1c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.558287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a230211180742ef9efd4d62b630d211, user_id=5628a861c90042d88b95f2d7b898ed52, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.560238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.560870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.561206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.561833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.562078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] PATH_INFO: `/v3/projects/dcf7388b8f11451aa0970b50749e1a1a/users/de4b4da5a78848f5831f6a6f5e929996/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.564663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.576077 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 636/1263] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:30 2022] PUT /identity/v3/projects/5a230211180742ef9efd4d62b630d211/users/5628a861c90042d88b95f2d7b898ed52/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:30.577114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.579303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf7388b8f11451aa0970b50749e1a1a, user_id=de4b4da5a78848f5831f6a6f5e929996, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.582424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.595737 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 628/1264] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:30 2022] PUT /identity/v3/projects/dcf7388b8f11451aa0970b50749e1a1a/users/de4b4da5a78848f5831f6a6f5e929996/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:30.596654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.638862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.646367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730b17-7360-4dc9-afad-ac49603c387f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.668832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ecb7-14e0-4521-8306-5b223a314623 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.674908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.675521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.675800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.676099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.676737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.678339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.688965 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 629/1265] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.690184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.700194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615ef5-35bd-4413-8e46-dbf2b7bfcc24 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.705790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.706382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.706662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.706774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.707026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.707307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.707587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.707714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.707883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.708530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.709287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.710131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.720073 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 630/1266] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.720880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.724723 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 637/1267] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.724723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.731962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f162e3-11dd-4114-b96c-a9fdcb5eb341 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.733945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1323e6-407d-4c43-9d7d-c6f906726534 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.737045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.737633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.737917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.738196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.738574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.738826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.739154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.739433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.739704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.740361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.740468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.741925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15eb20-4638-4eb0-9d1c-64fbe547750b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.751629 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 631/1268] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.752347 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 638/1269] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.752476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.753471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.753757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.754029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.762079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0308fb7-c5b2-4f43-90fd-3b97e11f1ccf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.766756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.767352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.767659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.767966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.769151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.770825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980a1a-ab0b-4460-b026-793468c01912 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.773985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:30.775199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:30.781342 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 632/1270] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.782663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.782951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.783226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.786045 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 639/1271] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:30.787072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.797481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d324a-1231-4a57-b87b-c63cdfd77915 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.802058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.802649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.802955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.803225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.803865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.805492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.812349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] MFA Rules not processed for user `de4b4da5a78848f5831f6a6f5e929996`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:30.813571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:30.815632 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 640/1272] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.816461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.825767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25974ce-0e7f-4303-8c09-11e4158c7a2c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.831144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.831731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.832054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.832329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.832961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.835111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.846290 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 641/1273] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.847128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.856817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbfb9-ce3d-4c5c-b2fa-9a745dfa8f9a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.862460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.863107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.863385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.863658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] PATH_INFO: `/v3/projects/dfb46376a666496b896ad085315c58fd/users/dda9dd9eb8d3446c96b0c702dd09d2fa/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.878517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb46376a666496b896ad085315c58fd, user_id=dda9dd9eb8d3446c96b0c702dd09d2fa, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.881220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.884021 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 633/1274] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:30.887994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.895654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fc23c-a4aa-4376-8cfc-25e5be617237 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.898732 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 642/1275] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:30 2022] PUT /identity/v3/projects/dfb46376a666496b896ad085315c58fd/users/dda9dd9eb8d3446c96b0c702dd09d2fa/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:30.902684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.940807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.956077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.956822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.957165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.957432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] PATH_INFO: `/v3/projects/17d15ee74bf04d2992143e64378fe4d8/users/6ce7329aa516439aade4a5163f5c5ecd/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.964795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c266f-c95c-45e4-afaf-434a17958bd3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.971479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.972353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.972738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.973042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.973453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d15ee74bf04d2992143e64378fe4d8, user_id=6ce7329aa516439aade4a5163f5c5ecd, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.973679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.975292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.976217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.987343 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 643/1276] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:30.988364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.990762 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 634/1277] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:30 2022] PUT /identity/v3/projects/17d15ee74bf04d2992143e64378fe4d8/users/6ce7329aa516439aade4a5163f5c5ecd/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:30.991746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.998355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9fc33-c01e-46d7-abf2-9cd0f3a29b25 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.007768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:31.057420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdc5c-1375-4e09-af42-865d4c91fc64 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.057914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.058521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.058798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.059071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.059703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.061539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.062380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.062520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.062844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.063209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.072210 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 644/1278] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:31.072623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.072975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.074255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.082339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea8bc-020b-4ed4-8357-e668d7736cb9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.084265 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 635/1279] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.085090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.086959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.087591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.087892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.088174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] PATH_INFO: `/v3/projects/4081d4f735b04367a67a03b9539f5432/users/5f9a55c605f04f478d0a71679d8bf6a1/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.095335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ca9c-c080-41df-8e5f-3ff10c1c9245 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.100257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.100964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.101419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.101638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] PATH_INFO: `/v3/projects/5e171056a4354ca695c18f115bfb750f/users/59bad833caf84817b8553d699b2fa04f/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.104135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4081d4f735b04367a67a03b9539f5432, user_id=5f9a55c605f04f478d0a71679d8bf6a1, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.106802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.120132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e171056a4354ca695c18f115bfb750f, user_id=59bad833caf84817b8553d699b2fa04f, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.122960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25cf78-eddf-4fd3-94df-2b6348a68858 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.127845 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 645/1280] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:31 2022] PUT /identity/v3/projects/4081d4f735b04367a67a03b9539f5432/users/5f9a55c605f04f478d0a71679d8bf6a1/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:31.127845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.140160 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 636/1281] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:31 2022] PUT /identity/v3/projects/5e171056a4354ca695c18f115bfb750f/users/59bad833caf84817b8553d699b2fa04f/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:31.145148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.145432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.145719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.168535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.169840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.210027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcadd3-7728-4744-8720-b704ee0f3d73 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.234158 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 637/1282] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.235003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.255298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16fef-8391-4ca7-be49-502ce4606228 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.262088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.262867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.263217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.263555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] PATH_INFO: `/v3/projects/f150d0c748e54c3eb4943b2b41adb99a/users/aacade278860491a9eac6f86b9b2a319/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.277583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:31.283144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f150d0c748e54c3eb4943b2b41adb99a, user_id=aacade278860491a9eac6f86b9b2a319, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.287070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd45d-d636-4a31-a602-5ad2c9867ba7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.292127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.293095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.293332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.293701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.294341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.296622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.302905 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 638/1283] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:31 2022] PUT /identity/v3/projects/f150d0c748e54c3eb4943b2b41adb99a/users/aacade278860491a9eac6f86b9b2a319/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:31.304445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fcd6-2a95-4c07-87e2-d008953e694c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.304732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fcd6-2a95-4c07-87e2-d008953e694c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.305006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fcd6-2a95-4c07-87e2-d008953e694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.331606 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 646/1284] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:31.333879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.342182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c9d9fcd6-2a95-4c07-87e2-d008953e694c None None] MFA Rules not processed for user `6ce7329aa516439aade4a5163f5c5ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.345702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c9d9fcd6-2a95-4c07-87e2-d008953e694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.406963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:31.416645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1e4f-af4d-4c20-8909-a86a6e1fa1b7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.421689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.422339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.422616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.422894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] PATH_INFO: `/v3/projects/52ed34115b474dc3a4cb253a8d1ba052/users/602bf4e9df27414a8fd4880da5f6322f/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.427030 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 639/1285] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.429467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.430017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.430522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.440169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ed34115b474dc3a4cb253a8d1ba052, user_id=602bf4e9df27414a8fd4880da5f6322f, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.443323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9408e3-43bd-48d3-9776-e83643701325 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.454263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.455615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.458221 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 647/1286] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:31 2022] PUT /identity/v3/projects/52ed34115b474dc3a4cb253a8d1ba052/users/602bf4e9df27414a8fd4880da5f6322f/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:31.463335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829a238-b4b4-41fa-9cb1-8dc5f5e8645d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.464002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829a238-b4b4-41fa-9cb1-8dc5f5e8645d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.464766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829a238-b4b4-41fa-9cb1-8dc5f5e8645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.497235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b829a238-b4b4-41fa-9cb1-8dc5f5e8645d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.499187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b829a238-b4b4-41fa-9cb1-8dc5f5e8645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.541232 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 640/1287] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.542630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.570789 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 648/1288] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.572350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.572790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.573190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.602264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.603500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.620002 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 649/1289] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.621150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.631369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571e4e-5d56-414a-893a-9efe80018130 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.634126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440ea1-5c6b-4041-be9b-9353e9076642 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.635115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.635725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.636140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.636520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.638898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.640353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.640662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.641081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.641677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.643653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6073df5-d607-47c9-abda-12b23399bbb4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.648668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.650434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.664484 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 641/1290] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.665448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.669353 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 650/1291] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:31.670941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.671480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.671976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.706336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] MFA Rules not processed for user `602bf4e9df27414a8fd4880da5f6322f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:31.707488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:31.736583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:31.739281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210744-e6a0-4695-801d-edbfd49059f5 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.745927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.746982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.747266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.747716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.782158 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 651/1292] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:31.783031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.793333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5deb-4583-4c31-9a87-802b785fb356 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.798353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.799058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.799285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.799559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.807771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:31.809265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.811351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.824975 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 652/1293] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.825362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.829281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.835547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e937f5-b883-45f2-a333-cfcec3ce5106 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.836926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.857834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.861846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.862425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.862937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.863683 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 642/1294] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.866187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.884588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82ef9-5c86-4474-97c0-e25accc4bf78 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.896751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.897400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.898312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.898598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.898916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.901205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.918755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.921911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.923713 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 653/1295] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.925005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.941359 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 643/1296] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:31.943715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:31.952876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cdd3c-a65c-4501-955f-8802672d971f service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.973465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.974101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.974246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc81b14-14b8-4d1f-a467-9f2e1dd96e3e service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:31.974424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.974761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.976339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.981593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:31.982592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:31.984418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:31.984873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:31.985251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:31.986789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:31.993014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.007968 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 654/1297] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:32.013363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.036766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f8ae-88cc-4d92-9355-27fa0216e3ad admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.053724 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 644/1298] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:31 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:32.056396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.057526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.058297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.058598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.060309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] PATH_INFO: `/v3/projects/d4160cf367564d61975d34899a31d9dc/users/74854ac7aeaf431eb8735cd73b4d8a5e/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.100786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4160cf367564d61975d34899a31d9dc, user_id=74854ac7aeaf431eb8735cd73b4d8a5e, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.110596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.142195 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 655/1299] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:32 2022] PUT /identity/v3/projects/d4160cf367564d61975d34899a31d9dc/users/74854ac7aeaf431eb8735cd73b4d8a5e/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:39:32.147078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.210047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d3b6-6560-4a68-ab3a-1a2a227a1116 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.277960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c15f25-44b1-4aff-b5dd-ed31a260df69 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.284282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.285453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.286032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.286659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.287550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.289508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.303749 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 656/1300] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:32.308784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.323092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0324e-c88f-419d-8797-c141cb8aeb59 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.328624 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.329376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.329724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.330073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] PATH_INFO: `/v3/projects/d4160cf367564d61975d34899a31d9dc/users/74854ac7aeaf431eb8735cd73b4d8a5e/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.332166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4160cf367564d61975d34899a31d9dc, user_id=74854ac7aeaf431eb8735cd73b4d8a5e, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.337641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34a52-5a5c-44ab-86e3-2c1158a29e2a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.368395 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 657/1301] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:32 2022] PUT /identity/v3/projects/d4160cf367564d61975d34899a31d9dc/users/74854ac7aeaf431eb8735cd73b4d8a5e/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:32.380726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.381018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.381293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.399900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.400498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.400780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.401628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.402291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.404769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.447618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] MFA Rules not processed for user `74854ac7aeaf431eb8735cd73b4d8a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:32.453197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:32.459220 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 645/1302] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:32 2022] POST /identity/v3/users => generated 308 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:39:32.463052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.491419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20259e-0764-4675-a1a3-20ba239c5423 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.556108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:32.609968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:32.641206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.641836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.643586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.643586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.645419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.650394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.657236 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 658/1303] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:32.671268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.677220 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 646/1304] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:32.681098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.706306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201fb8-cc9f-47eb-9d43-10e93fa6b6a1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.724540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.725304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.725587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.729821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] PATH_INFO: `/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad/users/a71d807d43bc47908730477cd53f764d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:32.778346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab658a0e8eed41a888ecdfa1ef7be8ad, user_id=a71d807d43bc47908730477cd53f764d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:32.791094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:32.830512 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 647/1305] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:32 2022] PUT /identity/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad/users/a71d807d43bc47908730477cd53f764d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:32.831794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:32.845789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23152-0f83-4976-aee6-954410629f87 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:32.985752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:32.986385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:32.986661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:32.986928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.002967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff706-e7b9-476c-a8d0-f532dff066dd admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:33.026312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:33.026483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.026625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.026907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.027823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.029235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:33.059070 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 648/1306] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:33.064296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:33.084031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d94-1e4f-42fc-9718-9d23d54d632f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:33.100767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:33.101915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.101915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.102167 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] PATH_INFO: `/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad/users/a71d807d43bc47908730477cd53f764d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.109877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab658a0e8eed41a888ecdfa1ef7be8ad, user_id=a71d807d43bc47908730477cd53f764d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.115424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0262f6-46ae-4b5c-861c-ad8d0cab8c01 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:33.118724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.120237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:33.141438 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 649/1307] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:33 2022] PUT /identity/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad/users/a71d807d43bc47908730477cd53f764d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:33.152056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.152957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.153620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.163116 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 659/1308] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:33.230169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] MFA Rules not processed for user `a71d807d43bc47908730477cd53f764d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:33.231792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:33.236635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:33.246377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4572-4b5a-4a17-9455-178e831115c1 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:33.329618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:33.365350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:33.367758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.368768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.369046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.421604 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 650/1309] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:33.422608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:33.445789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca6191-d757-4fde-9ce5-a909e2ad39c3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:33.456465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:33.457087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.458626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.458931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.478180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.479658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:33.492612 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 651/1310] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:33.524682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.526673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11d912-cf9b-4efd-ac05-5bf0a06365f9 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:33.545904 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 660/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:33.785772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:33.823304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:33.933217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2827ce-28f5-4277-bc99-4cb861d2b68b service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:33.938978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:33.939624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:33.939933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:33.940206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] PATH_INFO: `/v3/users/602bf4e9df27414a8fd4880da5f6322f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:33.941375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] RBAC: Authorizing `identity:delete_user(user_id=602bf4e9df27414a8fd4880da5f6322f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:33.943329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:34.035514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602bf4e9df27414a8fd4880da5f6322f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:34.036316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602bf4e9df27414a8fd4880da5f6322f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:34.057600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602bf4e9df27414a8fd4880da5f6322f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:34.078273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602bf4e9df27414a8fd4880da5f6322f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:34.079980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602bf4e9df27414a8fd4880da5f6322f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:34.113364 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 652/1312] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:33 2022] DELETE /identity/v3/users/602bf4e9df27414a8fd4880da5f6322f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:34.133806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ca9c-4435-40c5-967b-692d50fff6f2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.134322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ca9c-4435-40c5-967b-692d50fff6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.134695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ca9c-4435-40c5-967b-692d50fff6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.175542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2db6ca9c-4435-40c5-967b-692d50fff6f2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:34.176938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2db6ca9c-4435-40c5-967b-692d50fff6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:34.300776 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 661/1313] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:34.392370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:34.394073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:34.481413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a59b-e01e-44af-8c31-69f34c868a0f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.481938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a59b-e01e-44af-8c31-69f34c868a0f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.482871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a59b-e01e-44af-8c31-69f34c868a0f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.485387 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 662/1314] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:39:34.494083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.494653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.495001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.546061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c573eb-435c-4f99-90ca-a7690d3c180e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:34.550756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:34.551697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.552179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.552606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.566618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:34.575402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb18a-5ae2-4b40-ab02-159867552bcc service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:34.587522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:34.589089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:34.595544 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 653/1315] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:34.729923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611307a-82c9-4d32-a66e-378c1c28cb9a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.730976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611307a-82c9-4d32-a66e-378c1c28cb9a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.731477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611307a-82c9-4d32-a66e-378c1c28cb9a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.734038 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 654/1316] 10.222.0.33 () {54 vars in 912 bytes} [Wed Oct 19 00:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:39:34.741613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.742113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.742572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.747219 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 663/1317] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:39:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:34.775596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:34.777758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:34.801847 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 655/1318] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:39:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:34.810408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:34.814244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:34.834239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:34.915539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc3a9b-8020-40d0-a9a6-37a3bda665b3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:34.921538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:34.922528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:34.924020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:34.924584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:34.946700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:34.949000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:34.970631 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 664/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:35.851729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:35.855470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:35.911251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729212d3-2642-4ff3-b7dc-837c6988dce4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:35.939823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:35.940505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:35.940787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:35.941060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] PATH_INFO: `/v3/projects/52ed34115b474dc3a4cb253a8d1ba052` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:35.943483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ed34115b474dc3a4cb253a8d1ba052)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:35.944582 dv-cinder-master-3-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:39:35.944582 dv-cinder-master-3-smb devstack@keystone.service[81722]: warnings.warn(msg) Oct 19 00:39:35.944582 dv-cinder-master-3-smb devstack@keystone.service[81722]: Oct 19 00:39:35.947644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:36.033659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:36.084888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ed34115b474dc3a4cb253a8d1ba052', 'request_id': 'req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.102361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ed34115b474dc3a4cb253a8d1ba052', 'request_id': 'req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.137861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ed34115b474dc3a4cb253a8d1ba052', 'request_id': 'req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.175340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] The token cache is being invalidate because project 52ed34115b474dc3a4cb253a8d1ba052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:36.175647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.176834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.195878 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 656/1320] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:35 2022] DELETE /identity/v3/projects/52ed34115b474dc3a4cb253a8d1ba052 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:36.196238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:36.208562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb9d5c-f073-4b01-818d-65df5ad167db service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:36.366753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:36.367399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:36.367679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:36.367986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] PATH_INFO: `/v3/users/a71d807d43bc47908730477cd53f764d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:36.370192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71d807d43bc47908730477cd53f764d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:36.371237 dv-cinder-master-3-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:39:36.371237 dv-cinder-master-3-smb devstack@keystone.service[81723]: warnings.warn(msg) Oct 19 00:39:36.371237 dv-cinder-master-3-smb devstack@keystone.service[81723]: Oct 19 00:39:36.372483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:36.481964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71d807d43bc47908730477cd53f764d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.483902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71d807d43bc47908730477cd53f764d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.489252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71d807d43bc47908730477cd53f764d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.501149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71d807d43bc47908730477cd53f764d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.518188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c441bdb4-d6fb-4f63-96ec-67c9a2a78b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71d807d43bc47908730477cd53f764d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:36.556449 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 665/1321] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:36 2022] DELETE /identity/v3/users/a71d807d43bc47908730477cd53f764d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:37.526972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:37.528641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:37.570574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cde05-0387-4a10-89c9-c5f5ec574e3f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:37.739009 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26dc8-164b-444f-9709-021d95a220e5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:37.739515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26dc8-164b-444f-9709-021d95a220e5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:37.739996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26dc8-164b-444f-9709-021d95a220e5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:37.742616 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 666/1322] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:39:37.750849 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58508be-acff-4eac-9a07-f8a2fcfea45f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:37.751824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58508be-acff-4eac-9a07-f8a2fcfea45f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:37.751980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58508be-acff-4eac-9a07-f8a2fcfea45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:37.760151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:37.760889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:37.761445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:37.761632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] PATH_INFO: `/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:37.767448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab658a0e8eed41a888ecdfa1ef7be8ad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:37.773048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:37.928775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab658a0e8eed41a888ecdfa1ef7be8ad', 'request_id': 'req-68e5d48e-0499-49f4-b17b-2d35fae8e58d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:37.960273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab658a0e8eed41a888ecdfa1ef7be8ad', 'request_id': 'req-68e5d48e-0499-49f4-b17b-2d35fae8e58d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:37.973692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab658a0e8eed41a888ecdfa1ef7be8ad', 'request_id': 'req-68e5d48e-0499-49f4-b17b-2d35fae8e58d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:37.994481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] The token cache is being invalidate because project ab658a0e8eed41a888ecdfa1ef7be8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:37.994774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:37.995469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68e5d48e-0499-49f4-b17b-2d35fae8e58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.001739 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 657/1323] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:37 2022] DELETE /identity/v3/projects/ab658a0e8eed41a888ecdfa1ef7be8ad => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:38.009224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34766-57e8-46fc-8fae-bb17619637ab None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.009671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34766-57e8-46fc-8fae-bb17619637ab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.016140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34766-57e8-46fc-8fae-bb17619637ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.016662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a58508be-acff-4eac-9a07-f8a2fcfea45f None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:38.019299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a58508be-acff-4eac-9a07-f8a2fcfea45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.063758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:38.078907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7fa34766-57e8-46fc-8fae-bb17619637ab None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:38.080742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7fa34766-57e8-46fc-8fae-bb17619637ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.185311 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 667/1324] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:38.191897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958b2e-c9a4-4a23-b9d2-c8ba32c1df3e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.191897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958b2e-c9a4-4a23-b9d2-c8ba32c1df3e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.192600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958b2e-c9a4-4a23-b9d2-c8ba32c1df3e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.199030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:38.209857 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 668/1325] 10.222.0.33 () {54 vars in 912 bytes} [Wed Oct 19 00:39:38 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:39:38.217872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.218252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.220697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.235607 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 658/1326] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:38.245565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.246012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.246391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.295116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:38.301934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.310458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:38.331675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.340395 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 669/1327] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:38.346076 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 659/1328] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:38.359714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.364285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.366918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.387575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c398-f0ad-49fe-828a-38fad393eb84 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.401376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.402006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.402285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.402557 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.403207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:38.403634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.405362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.439710 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 660/1329] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:38.440697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.461062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea83f5-5668-4aba-8a98-153ee8d0d260 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.478906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.480721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.481401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.491296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.495237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.499162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.555101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1ea61-b8bc-444e-9f00-de03c8fc17ac None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.563047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.563216 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 661/1330] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:38.564806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.567386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.570905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.571191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.571467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.595814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.597487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.633604 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 670/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:38.634585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.711038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1eace-efeb-4137-9cfb-529c70bf06ef service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.725695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.726230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.726503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.726772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.727405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.729599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f13f3-4d95-4df5-9bfb-a475ff514cdf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.737949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.738491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.739147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.739428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.739703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] PATH_INFO: `/v3/users/de4b4da5a78848f5831f6a6f5e929996` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.741296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4b4da5a78848f5831f6a6f5e929996)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.744046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.790878 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 671/1332] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:38.795246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.816978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19917af1-6e49-4e04-97e0-6b626b0bb4b3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.824530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.825410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.825851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.826273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.827221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.829063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.844810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4b4da5a78848f5831f6a6f5e929996'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.846662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4b4da5a78848f5831f6a6f5e929996'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.852588 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 672/1333] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:38.859609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.861872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:38.865797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4b4da5a78848f5831f6a6f5e929996'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.879508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209808b-2b2e-4534-bd1e-394730f9e0a3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.887357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:38.890790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.891500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.892285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.894244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4b4da5a78848f5831f6a6f5e929996'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.894864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-47e3fe1f-5306-44a4-9c4a-a1a4df7c45da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4b4da5a78848f5831f6a6f5e929996'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:38.895207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:38.897403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:38.919714 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 673/1334] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:38.922312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:38.926891 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 662/1335] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:38 2022] DELETE /identity/v3/users/de4b4da5a78848f5831f6a6f5e929996 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:38.944354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7e6c-7851-47db-b8e4-8c13c13feec1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:38.944646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7e6c-7851-47db-b8e4-8c13c13feec1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:38.944932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7e6c-7851-47db-b8e4-8c13c13feec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:38.950599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba4bd-ee76-4330-9dff-9181718551d0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:38.996100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-172e7e6c-7851-47db-b8e4-8c13c13feec1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:38.997351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-172e7e6c-7851-47db-b8e4-8c13c13feec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:39.060335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:39.097834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:39.099760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:39.099760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:39.099760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] PATH_INFO: `/v3/projects/b687eb33c29a4d7c94682efa7b06811a/users/60ebaa015fd4405f97d68edcdee12e5b/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:39.134678 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b687eb33c29a4d7c94682efa7b06811a, user_id=60ebaa015fd4405f97d68edcdee12e5b, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:39.137627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:39.173664 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 663/1336] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:39.186526 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 674/1337] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:38 2022] PUT /identity/v3/projects/b687eb33c29a4d7c94682efa7b06811a/users/60ebaa015fd4405f97d68edcdee12e5b/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:39.188693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:39.189052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:39.189336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:39.264442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] MFA Rules not processed for user `60ebaa015fd4405f97d68edcdee12e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:39.265892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:39.415190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:39.417023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:39.425572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:39.492842 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 664/1338] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:39.500971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:39.604846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776711c4-6d01-4fdf-81f5-5e1dbd746ae2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:39.617068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:39.617700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:39.617979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:39.618250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:39.715942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69333fbc-1b1f-495b-8000-e91eeec6ec29 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:39.728662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:39.729305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:39.729591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:39.729866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:39.730515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:39.742502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:39.819828 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 665/1339] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:39 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:39:39.824260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:39.826042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:39.829500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:39.864594 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 675/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:39:39.929746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:39.979627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84221f-a97c-48a2-ab14-9e7f962dd720 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:39.990965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:39.993758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:39.994120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:39.994346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:39.994971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:40.003279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:40.061938 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 666/1341] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:39 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:40.062115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:40.079719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9a83-b6e8-4ebb-9d69-917d0c34cdbc service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:40.088719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:40.089350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:40.089629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:40.089900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:40.090549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:40.093627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:40.117749 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 676/1342] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:39:40.119815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:40.143166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737a78-8b53-48a3-a031-2269a35d669a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:40.156086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:40.157022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:40.157746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:40.158819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:40.159722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:40.162281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812630e0-7e2e-435e-b465-83b47227517e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:40.209074 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 667/1343] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:40.209415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:40.223338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6452f0-0dd3-4c96-a94a-71974665a71a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:40.229856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:40.230731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:40.231278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:40.231657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] PATH_INFO: `/v3/projects/c822ac60fb6241bc854267a4891a8e3b/users/a7b77ebdc4ad4dc89c7159687ccfc6e9/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:40.256634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c822ac60fb6241bc854267a4891a8e3b, user_id=a7b77ebdc4ad4dc89c7159687ccfc6e9, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:40.262568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:40.281095 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 677/1344] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:40 2022] PUT /identity/v3/projects/c822ac60fb6241bc854267a4891a8e3b/users/a7b77ebdc4ad4dc89c7159687ccfc6e9/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:39:40.292745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:40.293254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:40.294480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:40.365062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] MFA Rules not processed for user `a7b77ebdc4ad4dc89c7159687ccfc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:40.366586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:40.544774 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 668/1345] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:40.548289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:40.815647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684914a3-dc1c-430c-b9a4-032dd2508d05 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:40.837720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:40.837720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:40.838662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:40.838662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:40.839549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:40.846244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:40.946259 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 678/1346] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:40 2022] POST /identity/v3/projects => generated 385 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:40.949779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:40.968006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef519d-02b3-4fec-8340-529a6616842a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:41.128097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:41.128741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.129094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.129300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.135107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:41.139669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:41.229601 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 669/1347] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:40 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:41.232000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:41.243214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:41.273445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71341e-ed0a-4805-8098-fa93cd7c2301 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:41.292045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:41.293353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.293640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.293824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.294464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:41.300890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:41.335252 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 679/1348] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:41.336524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:41.351427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17b7b-66f7-4407-b035-5e2d4e546eb6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:41.369190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:41.369877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.370162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.370441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] PATH_INFO: `/v3/projects/a32b2b16745c485dbbb84a17b76619b3/users/c369ab7b42714153904dd678aac2bbbc/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.419890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b2b16745c485dbbb84a17b76619b3, user_id=c369ab7b42714153904dd678aac2bbbc, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:41.422924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:41.454565 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 670/1349] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:41 2022] PUT /identity/v3/projects/a32b2b16745c485dbbb84a17b76619b3/users/c369ab7b42714153904dd678aac2bbbc/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:41.462156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:41.477403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a0e6-8362-4619-9e2b-55835f84516f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:41.706742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:41.708487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.708817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.709137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.710411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:41.712422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078611d-3d7d-4752-8b2a-9683b81f856b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:41.760357 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 680/1350] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:41.765109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:41.780537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffacc91-1b90-4d81-adfc-0f1a474fbe33 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:41.791652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:41.792913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.793379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.793829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] PATH_INFO: `/v3/projects/a32b2b16745c485dbbb84a17b76619b3/users/c369ab7b42714153904dd678aac2bbbc/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.796554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b2b16745c485dbbb84a17b76619b3, user_id=c369ab7b42714153904dd678aac2bbbc, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:41.799762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:41.821215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:41.831789 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 671/1351] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:41 2022] PUT /identity/v3/projects/a32b2b16745c485dbbb84a17b76619b3/users/c369ab7b42714153904dd678aac2bbbc/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:41.844769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:41.845822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:41.846273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:41.995260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] MFA Rules not processed for user `c369ab7b42714153904dd678aac2bbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:42.005027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:42.284514 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 681/1352] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:42.310923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:42.326228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:42.364387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:42.372847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:42.588819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc033da-36b4-43ce-a6cd-66930bd37572 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:42.599804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:42.600490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:42.600953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:42.601235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:42.627452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:42.628869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee6944-63bb-4e91-8530-80cc677c8b8b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:42.629001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:42.640899 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 672/1353] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:42.646467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:42.648285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:42.649073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:42.651962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] PATH_INFO: `/v3/projects/dcf7388b8f11451aa0970b50749e1a1a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:42.655791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf7388b8f11451aa0970b50749e1a1a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:42.658010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:42.719599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:42.788548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf7388b8f11451aa0970b50749e1a1a', 'request_id': 'req-18462fda-458e-4622-8907-f62bc8d44b65'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:42.801287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf7388b8f11451aa0970b50749e1a1a', 'request_id': 'req-18462fda-458e-4622-8907-f62bc8d44b65'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:42.811510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf7388b8f11451aa0970b50749e1a1a', 'request_id': 'req-18462fda-458e-4622-8907-f62bc8d44b65'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:42.853330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] The token cache is being invalidate because project dcf7388b8f11451aa0970b50749e1a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:42.857068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:42.858130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:42.860438 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 682/1354] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:42 2022] DELETE /identity/v3/projects/dcf7388b8f11451aa0970b50749e1a1a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:42.864759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:42.888164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce4fd-ddbe-4316-9790-094cd57658e7 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:43.089851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:43.090947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:43.091486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:43.091969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] PATH_INFO: `/v3/users/74854ac7aeaf431eb8735cd73b4d8a5e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:43.094505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=74854ac7aeaf431eb8735cd73b4d8a5e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:43.101639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:43.251802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74854ac7aeaf431eb8735cd73b4d8a5e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:43.252545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74854ac7aeaf431eb8735cd73b4d8a5e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:43.278454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74854ac7aeaf431eb8735cd73b4d8a5e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:43.309298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74854ac7aeaf431eb8735cd73b4d8a5e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:43.313523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74854ac7aeaf431eb8735cd73b4d8a5e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:43.344489 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 673/1355] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:42 2022] DELETE /identity/v3/users/74854ac7aeaf431eb8735cd73b4d8a5e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:43.903994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:43.907083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:43.989014 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462fda-458e-4622-8907-f62bc8d44b65 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:44.055230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:44.055950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:44.056334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:44.056706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:44.059244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:44.142396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:44.144259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb80cc-3916-4e4e-9520-fbe05fc62dcc service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:44.156579 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 683/1356] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:44.350439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:44.352057 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:44.470813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:44.648060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf19ee6-03ce-4dc5-b994-9c973fbcc7ae admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:44.661389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:44.662229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:44.662521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:44.662783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] PATH_INFO: `/v3/projects/d4160cf367564d61975d34899a31d9dc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:44.665462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4160cf367564d61975d34899a31d9dc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:44.668486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:44.762853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4160cf367564d61975d34899a31d9dc', 'request_id': 'req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:44.783884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4160cf367564d61975d34899a31d9dc', 'request_id': 'req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:44.796814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4160cf367564d61975d34899a31d9dc', 'request_id': 'req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:44.828087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] The token cache is being invalidate because project d4160cf367564d61975d34899a31d9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:44.828722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:44.830929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-120f2a95-1eee-4299-9c2f-a5b8aa1c3cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:44.838418 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 674/1357] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:44 2022] DELETE /identity/v3/projects/d4160cf367564d61975d34899a31d9dc => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:44.840383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:44.840707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:44.841036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:44.921874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:44.929807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:44.959195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:45.065110 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 684/1358] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:45.075438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.075438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.075438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.107654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:45.111691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:45.128208 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 675/1359] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:45.133449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.151281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ac71-ed7d-45d0-b3ff-47ac343f70aa None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.158274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.159207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.159555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.159822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.160835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:45.161139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.163776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.183783 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 685/1360] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:45.188126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.201141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c67b8-a55b-4594-b782-52037c739be2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.208224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.208843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.209119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.209390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.210617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.213815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.266591 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 676/1361] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:45 2022] POST /identity/v3/projects => generated 409 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:39:45.272244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.289588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef26716-1783-44e8-bddf-3bbe4f3fdd87 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.451814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.452474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.452758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.453030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.453687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.455647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.503271 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 686/1362] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:45 2022] POST /identity/v3/users => generated 305 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:39:45.505292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.556115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8176e19-89ac-4dfe-97de-cd2576f75f13 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.574465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.579317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.579317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.579317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.585947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.587748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.654703 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 677/1363] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:45.659176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.672351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303053-f037-4401-8c4e-369a9c60af32 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.692850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.693662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.695454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.695844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.696665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.703196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa22f74-ba12-4468-a0c7-7aabc858c5e9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.735903 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 687/1364] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:45.739352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:45.757536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57350db-646a-47ab-8b3f-26f9343e85df admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:45.768424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:45.769228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.769667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.770035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] PATH_INFO: `/v3/projects/80aa5bbd58594f0694c267ede88883e4/users/00c734682cba4776930243948ebc35f3/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.797980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aa5bbd58594f0694c267ede88883e4, user_id=00c734682cba4776930243948ebc35f3, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:45.803322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:45.833697 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 678/1365] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:45 2022] PUT /identity/v3/projects/80aa5bbd58594f0694c267ede88883e4/users/00c734682cba4776930243948ebc35f3/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:45.844524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:45.845424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:45.845424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:45.927329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] MFA Rules not processed for user `00c734682cba4776930243948ebc35f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:45.928727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:46.105487 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 688/1366] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:46.108283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.237989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:46.293087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e888-39e1-4b4b-b96c-4133e1bcaadf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.309082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:46.309945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.312382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.318152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:46.319111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:46.325596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:46.412007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.412243 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 679/1367] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:46 2022] POST /identity/v3/projects => generated 409 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:46.429345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bfeee-213d-4490-bcc3-462f2c1669e3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.465791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:46.571613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:46.572321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.572609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.572885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:46.573590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:46.577844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:46.622533 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 689/1368] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:46 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:46.627381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.649182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae8da9-6d6e-4036-b5ec-b09121262bca admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.663017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:46.663989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.664274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.664544 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:46.665195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:46.667676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:46.672711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.675155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:46.694136 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 680/1369] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:46.698293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.713028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60b71-a1ab-4b43-9fab-60237e5e7392 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.721585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b64c8-893d-430b-9503-3104db909c01 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.721825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:46.722598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.723020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.723952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] PATH_INFO: `/v3/users/6ce7329aa516439aade4a5163f5c5ecd` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:46.730066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce7329aa516439aade4a5163f5c5ecd)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:46.733594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:46.736960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:46.737839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.738281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.738715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] PATH_INFO: `/v3/projects/3c0aab841db144c5a42315acc80572cc/users/acfd2ca311df49ea94acfb65f9fce843/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:46.783555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0aab841db144c5a42315acc80572cc, user_id=acfd2ca311df49ea94acfb65f9fce843, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:46.786695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:46.813142 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 681/1370] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:46 2022] PUT /identity/v3/projects/3c0aab841db144c5a42315acc80572cc/users/acfd2ca311df49ea94acfb65f9fce843/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:39:46.819587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:46.846101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce7329aa516439aade4a5163f5c5ecd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:46.848616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce7329aa516439aade4a5163f5c5ecd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:46.849948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce7329aa516439aade4a5163f5c5ecd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:46.868822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce7329aa516439aade4a5163f5c5ecd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:46.893394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b383ff7f-96b5-4332-9061-eb7944781c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce7329aa516439aade4a5163f5c5ecd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:46.958056 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 690/1371] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:46 2022] DELETE /identity/v3/users/6ce7329aa516439aade4a5163f5c5ecd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:46.959930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf6b72-2766-4a6c-98d9-bac51a06346e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:46.961575 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:46.963598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:46.964458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.010813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:47.016118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:47.086646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:47.087439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:47.087888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:47.088265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.089067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:47.090850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:47.111745 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 682/1372] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:47.113075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:47.115280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:47.130709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1364f7-1399-4bc1-8402-cab7600bab94 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:47.136955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:47.137822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:47.138202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:47.138571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] PATH_INFO: `/v3/projects/3c0aab841db144c5a42315acc80572cc/users/acfd2ca311df49ea94acfb65f9fce843/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.141622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0aab841db144c5a42315acc80572cc, user_id=acfd2ca311df49ea94acfb65f9fce843, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:47.144839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3058-b2bc-4a59-890f-0d832b01a3a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:47.167904 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 683/1373] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:47 2022] PUT /identity/v3/projects/3c0aab841db144c5a42315acc80572cc/users/acfd2ca311df49ea94acfb65f9fce843/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:47.176147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:47.176827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:47.177312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.211359 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 691/1374] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:47.238279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] MFA Rules not processed for user `acfd2ca311df49ea94acfb65f9fce843`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:47.239499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:47.260665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:47.263077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:47.286966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:47.294766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:47.408012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca9cfb-e71a-4902-a4ee-97ce0939ec1e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:47.418692 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 684/1375] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:47.433340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:47.435369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:47.524601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ec61-9061-4fdb-84a2-564cffb57897 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:47.529042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:47.529698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:47.530113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:47.530384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.560106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:47.562150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:47.590346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:47.590981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:47.591262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:47.591532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:47.593992 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 685/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:47 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:47.860965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:47.868793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e36f-b1de-40c2-b2a8-9c46fda5d380 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:47.883670 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 692/1377] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:48.052213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:48.063581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a874a4-9fb6-48cf-8e44-36d40f7dd63b service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:48.079409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:48.080070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:48.080376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:48.080642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:48.087278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:48.147937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:48.148431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:48.148683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:48.220106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] MFA Rules not processed for user `59bad833caf84817b8553d699b2fa04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:48.223882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:48.317338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:48.318814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:48.333533 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 686/1378] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:48 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:48.458925 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 693/1379] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:48.467891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:48.473201 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:48.699554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:48.744721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af86a0e-292b-464b-86e2-735dd31439c9 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:48.753338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:48.756188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:48.756471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:48.756754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:48.774614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:48.779397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc0c26-0753-481f-acd9-c18c8d99e80e service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:48.807805 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 687/1380] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:39:49.720992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:49.735819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159928e6-df94-436c-bc09-6fad2781af06 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:49.749771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:49.751889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:49.752983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:49.753478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:49.760462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:49.777087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:49.894731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:49.898791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b3e9e-0016-4fb7-9f3b-5c09fb4b733b service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:49.915830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:49.916325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:49.916395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:49.950909 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 694/1381] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:50.043652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] MFA Rules not processed for user `dda9dd9eb8d3446c96b0c702dd09d2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:50.048083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:50.325240 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 688/1382] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:50.326238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:50.327188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:50.327470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:50.392819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] MFA Rules not processed for user `dda9dd9eb8d3446c96b0c702dd09d2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:50.394083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:50.443484 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 695/1383] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:50.458404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:50.460072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:50.555433 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1a7d-6a36-421a-a108-3b03441f0f8f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:50.594175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:50.597517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:50.652845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:50.653079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:50.685614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:50.697091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c18c2-f14e-4191-8d55-da2e91ae9aef service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:50.741361 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 689/1384] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:39:51.256290 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:51.257832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:51.294156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574588-e50d-4f23-8f92-fcc677674e90 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:51.307568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:51.308243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.308622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.308800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] PATH_INFO: `/v3/projects/17d15ee74bf04d2992143e64378fe4d8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.309929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d15ee74bf04d2992143e64378fe4d8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:51.319051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:51.496856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d15ee74bf04d2992143e64378fe4d8', 'request_id': 'req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:51.509490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d15ee74bf04d2992143e64378fe4d8', 'request_id': 'req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:51.524646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d15ee74bf04d2992143e64378fe4d8', 'request_id': 'req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:51.561668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] The token cache is being invalidate because project 17d15ee74bf04d2992143e64378fe4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:51.562123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:51.565060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a7fcd78-f400-4070-bfbd-d8d74f08f5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:51.567304 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 696/1385] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:51 2022] DELETE /identity/v3/projects/17d15ee74bf04d2992143e64378fe4d8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:51.572110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31236-866e-45a5-baea-ee2da6a9e714 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.573001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31236-866e-45a5-baea-ee2da6a9e714 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.573454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31236-866e-45a5-baea-ee2da6a9e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.615837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3ba31236-866e-45a5-baea-ee2da6a9e714 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:51.617149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3ba31236-866e-45a5-baea-ee2da6a9e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:51.716348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c525-5728-4890-88d9-b24e7d4a4a6c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.716929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c525-5728-4890-88d9-b24e7d4a4a6c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.718113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c525-5728-4890-88d9-b24e7d4a4a6c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.720235 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 697/1386] 10.222.0.33 () {54 vars in 912 bytes} [Wed Oct 19 00:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:39:51.730692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.731241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.731745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.810175 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 690/1387] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:51.814779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.815691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.816674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.837764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:51.839609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:51.867257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:51.870912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:51.891940 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 691/1388] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:51.896517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:51.932108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d920694-764b-4efd-b373-ff06c66d0117 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:51.959038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:51.966334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:51.966765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:51.967246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:51.970241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:39:51.971769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:51.973611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.017686 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 692/1389] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:39:52.032949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.035108 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 698/1390] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:39:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:52.060438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49492c-9d11-480a-9f53-215542cc6570 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.076001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.076868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.077443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.077823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.078716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.082636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.092808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.094571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:52.126987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db492c00-f180-4e9c-ae18-046aa0e6dbf2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.138081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.141545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.143221 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.145454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.186587 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 693/1391] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:39:52 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:52.187977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.199885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.201347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.237884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:52.252602 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 699/1392] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:39:52.354705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8790a-bf31-4e89-8303-8759157e4354 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.367250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.368117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.368232 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.368943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.369603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.375497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.423255 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 694/1393] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:39:52 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:39:52.426944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.448966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c378-9dc7-47cd-b68b-dccbda7ec5d1 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.463330 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.473885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.474590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.475600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.476472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.478527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.485336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:52.520696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.522003 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 700/1394] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:52.537466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2bba6-4aea-4d70-8de9-d4e74be0d860 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.557983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.558697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.558990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.559260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.559974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.571984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051dbe1-ceaf-43a7-9e0d-982e57b4d303 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.594918 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 695/1395] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:39:52.598186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.614521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f558e-d16a-4e2a-865b-4144cd56ccf6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:52.636198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:52.637447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.638021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.640789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] PATH_INFO: `/v3/projects/caee808a710b4e52858ef4be7b1e555a/users/4c5ae97b5ab2408f9b60ec26d5d45856/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.707350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] RBAC: Authorizing `identity:create_grant(project_id=caee808a710b4e52858ef4be7b1e555a, user_id=4c5ae97b5ab2408f9b60ec26d5d45856, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:52.718589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:52.757556 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 701/1396] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:39:52 2022] PUT /identity/v3/projects/caee808a710b4e52858ef4be7b1e555a/users/4c5ae97b5ab2408f9b60ec26d5d45856/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:52.772018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1ce4-4fac-4a04-86ff-50ca7cb3863e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:52.772634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1ce4-4fac-4a04-86ff-50ca7cb3863e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:52.773155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1ce4-4fac-4a04-86ff-50ca7cb3863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:52.867089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b36e1ce4-4fac-4a04-86ff-50ca7cb3863e None None] MFA Rules not processed for user `4c5ae97b5ab2408f9b60ec26d5d45856`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:52.874070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b36e1ce4-4fac-4a04-86ff-50ca7cb3863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:52.938114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:52.941543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:53.089210 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 696/1397] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:53.100761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:53.101119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:53.104049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:53.118210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f5190-b777-456b-bfc1-42cd46c2faea admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:53.142155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:53.142933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:53.143280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:53.145564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] PATH_INFO: `/v3/users/60ebaa015fd4405f97d68edcdee12e5b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:53.151311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ebaa015fd4405f97d68edcdee12e5b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:53.154899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:53.183807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] MFA Rules not processed for user `5628a861c90042d88b95f2d7b898ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:53.185073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:53.342403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ebaa015fd4405f97d68edcdee12e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:53.349559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ebaa015fd4405f97d68edcdee12e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:53.356628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ebaa015fd4405f97d68edcdee12e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:53.375531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ebaa015fd4405f97d68edcdee12e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:53.388699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e15aeefd-1669-4a8a-bdaf-df6b512be70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ebaa015fd4405f97d68edcdee12e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:53.440284 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 697/1398] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:53.453291 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 702/1399] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:52 2022] DELETE /identity/v3/users/60ebaa015fd4405f97d68edcdee12e5b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:39:53.455000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4589-ed8a-45e9-8ce8-be152204877f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:53.455563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4589-ed8a-45e9-8ce8-be152204877f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:53.456008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4589-ed8a-45e9-8ce8-be152204877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:53.456853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:53.458643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:53.510657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-54fb4589-ed8a-45e9-8ce8-be152204877f None None] MFA Rules not processed for user `59bad833caf84817b8553d699b2fa04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:53.511923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54fb4589-ed8a-45e9-8ce8-be152204877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:53.515105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:53.659257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:53.686125 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 703/1400] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:53.687618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5d9a-8fc9-4040-af97-ff822d518b36 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:53.687935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5d9a-8fc9-4040-af97-ff822d518b36 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:53.688217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5d9a-8fc9-4040-af97-ff822d518b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:53.739833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0513-ba21-4e40-ac9b-65a68bf21b4d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:53.786103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dd4a5d9a-8fc9-4040-af97-ff822d518b36 None None] MFA Rules not processed for user `5f9a55c605f04f478d0a71679d8bf6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:53.787602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dd4a5d9a-8fc9-4040-af97-ff822d518b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:53.957186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:53.959332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:53.959625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:53.962046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:53.971794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.003209 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 704/1401] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:54.007431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.007431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.007637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.061927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] MFA Rules not processed for user `5628a861c90042d88b95f2d7b898ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:54.063214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.115784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:54.123292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319ceaa-b7ae-40bc-880a-f660bd91a305 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:54.150165 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 698/1402] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:54.152343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.152629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.152903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.184473 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 705/1403] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:54.186226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:54.190755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.212832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:54.215404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.337355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:54.406411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929192c3-c2bf-41f7-8924-b539ff466c58 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:54.411131 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 699/1404] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:54.412660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:54.417462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:54.418367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.418646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.418910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.421645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.430745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55027d64-7f0c-4207-bb38-d22c7cfc4054 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:54.435139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:54.438215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02027-59e7-4b9a-81c7-d4f5043500ea service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:54.439481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:54.440330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.440677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.441083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.450575 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 706/1405] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:54.453205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.453657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.455007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.469965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:54.472651 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:54.495114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] MFA Rules not processed for user `aacade278860491a9eac6f86b9b2a319`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:54.496923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.497763 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 700/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:54.498511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:54.500634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:54.555002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:54.766046 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 707/1407] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:54.767435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:54.807041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc568a1-96b6-430f-a5bf-0c050abf1d82 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:54.807617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0f50-cd31-411c-b7bc-bd2039a617c4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:54.820753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:54.821380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.821670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.821940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.822089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:54.823411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:54.824619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:54.825164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:54.847481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:54.849451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:54.857409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:54.860441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:54.874478 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 708/1408] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:54.895967 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 701/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:55.605724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:55.607420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:55.634546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162546-aa44-4577-aaea-8c9f5c761556 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:55.648079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:55.650602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:55.651129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:55.652198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:55.675218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:55.676863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094e577-b6e6-4885-83e9-4efb908dc185 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:55.696643 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 702/1410] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:56.240740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:56.242899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:56.294966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ea37-7773-49fa-bfaa-89084c384a85 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:56.315379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:56.317307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:56.317984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:56.319495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] PATH_INFO: `/v3/users/00c734682cba4776930243948ebc35f3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:56.321645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c734682cba4776930243948ebc35f3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:56.328429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:56.474064 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c734682cba4776930243948ebc35f3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:56.474996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c734682cba4776930243948ebc35f3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:56.475732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c734682cba4776930243948ebc35f3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:56.494480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c734682cba4776930243948ebc35f3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:56.509828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ff4bc758-983e-4252-b811-742284b74642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c734682cba4776930243948ebc35f3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:56.558750 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 709/1411] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:56 2022] DELETE /identity/v3/users/00c734682cba4776930243948ebc35f3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:56.563178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70296-64e2-47b5-b836-3c86e01830b7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:56.564019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:56.564273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70296-64e2-47b5-b836-3c86e01830b7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:56.564594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:56.564920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70296-64e2-47b5-b836-3c86e01830b7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:56.565043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:56.568363 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 703/1412] 10.222.0.33 () {54 vars in 912 bytes} [Wed Oct 19 00:39:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:39:56.574164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:56.574691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:56.575149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:56.614281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:56.616158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:56.632332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:56.633631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:56.828729 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 704/1413] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:39:56.894591 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 710/1414] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:56.921646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:56.923768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:56.949176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f434-2aeb-419c-b86a-5c6526d43def None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:56.966630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:56.970515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:56.971095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:56.973903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:57.002838 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:57.008086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:57.034556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:57.036227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:57.052088 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 705/1415] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:57.060480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a76c-b1c5-42ee-8b99-f67ad6810c75 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:57.070910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:57.071687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:57.072142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:57.072544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:57.081300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:57.087939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:57.091025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5c381-cc93-4934-87cb-edd2324d694a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:57.109178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:57.112331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:57.122319 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 711/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:39:57.138121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2e1e5-79d8-4bcb-9277-66370b7a1f90 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:57.156991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:57.157645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:57.157926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:57.158200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] PATH_INFO: `/v3/users/4c5ae97b5ab2408f9b60ec26d5d45856` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:57.159495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5ae97b5ab2408f9b60ec26d5d45856)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:57.166556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:57.316897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5ae97b5ab2408f9b60ec26d5d45856'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:57.324454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5ae97b5ab2408f9b60ec26d5d45856'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:57.340513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5ae97b5ab2408f9b60ec26d5d45856'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:57.345897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:57.383236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5ae97b5ab2408f9b60ec26d5d45856'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:57.384344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5ae97b5ab2408f9b60ec26d5d45856'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:57.454829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030dc-b8f3-48f3-a475-c1c4e67a3344 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:57.455880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030dc-b8f3-48f3-a475-c1c4e67a3344 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:57.456616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030dc-b8f3-48f3-a475-c1c4e67a3344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:57.456815 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 706/1417] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:57 2022] DELETE /identity/v3/users/4c5ae97b5ab2408f9b60ec26d5d45856 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:57.501182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-044030dc-b8f3-48f3-a475-c1c4e67a3344 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:57.502872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-044030dc-b8f3-48f3-a475-c1c4e67a3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:57.876753 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 712/1418] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:58.056890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:58.059182 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:58.332165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4959-40ab-4b08-9fad-b1c6ffd0c08d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:58.370092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:58.371636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:58.377168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:58.377480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:58.445056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:58.454060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:58.492160 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 707/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:58.781026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f221-57ec-4cb1-9261-83fe2e44c845 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:58.781945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f221-57ec-4cb1-9261-83fe2e44c845 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:58.782404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f221-57ec-4cb1-9261-83fe2e44c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:58.898812 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c7e0f221-57ec-4cb1-9261-83fe2e44c845 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:58.900027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c7e0f221-57ec-4cb1-9261-83fe2e44c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:58.929283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:58.931088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:58.957357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447238d-1308-4514-a41b-1934aa7816e8 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:59.012780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:59.013433 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:59.013711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:59.014736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] PATH_INFO: `/v3/projects/b687eb33c29a4d7c94682efa7b06811a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:59.016369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b687eb33c29a4d7c94682efa7b06811a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:59.018328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:59.130072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b687eb33c29a4d7c94682efa7b06811a', 'request_id': 'req-c4125a2f-467a-4e57-8990-2883a33421c4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.136196 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 713/1420] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:39:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:59.142184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:59.142590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:59.142980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:59.162713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b687eb33c29a4d7c94682efa7b06811a', 'request_id': 'req-c4125a2f-467a-4e57-8990-2883a33421c4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.173374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b687eb33c29a4d7c94682efa7b06811a', 'request_id': 'req-c4125a2f-467a-4e57-8990-2883a33421c4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.205795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] The token cache is being invalidate because project b687eb33c29a4d7c94682efa7b06811a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:39:59.206690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.210711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.215250 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 708/1421] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:39:58 2022] DELETE /identity/v3/projects/b687eb33c29a4d7c94682efa7b06811a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:39:59.219245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:59.222921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:59.234631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] MFA Rules not processed for user `5628a861c90042d88b95f2d7b898ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:59.236668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:59.368845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4125a2f-467a-4e57-8990-2883a33421c4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:59.377079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:59.377984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:59.378419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:59.379623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] PATH_INFO: `/v3/users/a7b77ebdc4ad4dc89c7159687ccfc6e9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:59.381486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b77ebdc4ad4dc89c7159687ccfc6e9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:59.385067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:59.387219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:59.472400 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 714/1422] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:39:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:59.473671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:59.484688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:59.515708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b77ebdc4ad4dc89c7159687ccfc6e9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.519641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b77ebdc4ad4dc89c7159687ccfc6e9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.533224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b77ebdc4ad4dc89c7159687ccfc6e9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.554276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b77ebdc4ad4dc89c7159687ccfc6e9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.555094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b77ebdc4ad4dc89c7159687ccfc6e9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:39:59.586528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:59.618740 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 709/1423] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:39:59 2022] DELETE /identity/v3/users/a7b77ebdc4ad4dc89c7159687ccfc6e9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:39:59.803401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb85fe-88f5-42d8-bec1-6a44dff44a08 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:59.964454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:59.967184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:59.967473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:59.971091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:59.979629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:00.153317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:00.158418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:00.178007 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 715/1424] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:40:00.251480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:00.253652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:00.554843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9ecf-588c-4b07-9e09-130edb40b901 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:00.564885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:00.565612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:00.567179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:00.567467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] PATH_INFO: `/v3/projects/80aa5bbd58594f0694c267ede88883e4` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:00.569944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80aa5bbd58594f0694c267ede88883e4)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:00.574795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:00.691964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80aa5bbd58594f0694c267ede88883e4', 'request_id': 'req-f5927829-c034-4a69-84a8-5c1347364739'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:00.718674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80aa5bbd58594f0694c267ede88883e4', 'request_id': 'req-f5927829-c034-4a69-84a8-5c1347364739'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:00.740776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80aa5bbd58594f0694c267ede88883e4', 'request_id': 'req-f5927829-c034-4a69-84a8-5c1347364739'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:00.768194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] The token cache is being invalidate because project 80aa5bbd58594f0694c267ede88883e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:00.772074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:00.773965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:00.782929 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 710/1425] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:00 2022] DELETE /identity/v3/projects/80aa5bbd58594f0694c267ede88883e4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:00.784313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:00.807621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16236-27ac-43a7-a8ed-146a7d1955c5 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:00.931135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:01.011725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:01.011725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:01.014583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:01.014928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] PATH_INFO: `/v3/users/acfd2ca311df49ea94acfb65f9fce843` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:01.020950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfd2ca311df49ea94acfb65f9fce843)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:01.032443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:01.174773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfd2ca311df49ea94acfb65f9fce843'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:01.176200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfd2ca311df49ea94acfb65f9fce843'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:01.178054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfd2ca311df49ea94acfb65f9fce843'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:01.192381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfd2ca311df49ea94acfb65f9fce843'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:01.218990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b3d4b00a-8fff-416a-b9ae-d611d49fb1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfd2ca311df49ea94acfb65f9fce843'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:01.296050 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 716/1426] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:00 2022] DELETE /identity/v3/users/acfd2ca311df49ea94acfb65f9fce843 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:02.575053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:02.579441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:02.650677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927829-c034-4a69-84a8-5c1347364739 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:02.670584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:02.861769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ccc58-e5f7-4be0-a328-385a4caf8d69 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:02.862297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ccc58-e5f7-4be0-a328-385a4caf8d69 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:02.862490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ccc58-e5f7-4be0-a328-385a4caf8d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:02.867218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:02.868150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:02.868642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:02.869035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] PATH_INFO: `/v3/projects/caee808a710b4e52858ef4be7b1e555a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:02.870574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=caee808a710b4e52858ef4be7b1e555a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:02.872695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:02.953151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-aa6ccc58-e5f7-4be0-a328-385a4caf8d69 None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:02.953151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa6ccc58-e5f7-4be0-a328-385a4caf8d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:02.987968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caee808a710b4e52858ef4be7b1e555a', 'request_id': 'req-7d9f7888-e49e-48d4-9348-86ef65f487ea'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:02.998942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caee808a710b4e52858ef4be7b1e555a', 'request_id': 'req-7d9f7888-e49e-48d4-9348-86ef65f487ea'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.016126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caee808a710b4e52858ef4be7b1e555a', 'request_id': 'req-7d9f7888-e49e-48d4-9348-86ef65f487ea'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.035370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] The token cache is being invalidate because project caee808a710b4e52858ef4be7b1e555a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:03.035949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.037262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.043192 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 711/1427] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:02 2022] DELETE /identity/v3/projects/caee808a710b4e52858ef4be7b1e555a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:03.052242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:03.071408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:03.189730 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 717/1428] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 19 00:40:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:03.193522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121df3-6684-44a2-959f-27beeff4616f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.193903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121df3-6684-44a2-959f-27beeff4616f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.194123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121df3-6684-44a2-959f-27beeff4616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.276634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7888-e49e-48d4-9348-86ef65f487ea admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:03.294827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:03.297111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.298625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.299113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] PATH_INFO: `/v3/projects/c822ac60fb6241bc854267a4891a8e3b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.302139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c822ac60fb6241bc854267a4891a8e3b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:03.304937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-37121df3-6684-44a2-959f-27beeff4616f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:03.306687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37121df3-6684-44a2-959f-27beeff4616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:03.309270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:03.338021 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 718/1429] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:03.339198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37121df3-6684-44a2-959f-27beeff4616f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:03.341311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37121df3-6684-44a2-959f-27beeff4616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:03.375846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37121df3-6684-44a2-959f-27beeff4616f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:03.394532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:03.395592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.397916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.399254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.418440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:03.422349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44cd9-759c-458f-8f4d-65b5a72e8b33 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:03.450112 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 719/1430] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:03.452552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.455234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.456109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.470204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:03.503090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c822ac60fb6241bc854267a4891a8e3b', 'request_id': 'req-c1582fce-f6e4-4fa5-8467-26bcd413e07e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.508848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:03.518441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:03.518999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c822ac60fb6241bc854267a4891a8e3b', 'request_id': 'req-c1582fce-f6e4-4fa5-8467-26bcd413e07e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.552081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c822ac60fb6241bc854267a4891a8e3b', 'request_id': 'req-c1582fce-f6e4-4fa5-8467-26bcd413e07e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.611523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] The token cache is being invalidate because project c822ac60fb6241bc854267a4891a8e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:03.612276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.618924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.621449 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 712/1431] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:03 2022] DELETE /identity/v3/projects/c822ac60fb6241bc854267a4891a8e3b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:03.628577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:03.633975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:03.674282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:03.730335 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 720/1432] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:03.736129 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:03.800023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1582fce-f6e4-4fa5-8467-26bcd413e07e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:03.814930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:03.815613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.815906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.816185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] PATH_INFO: `/v3/users/c369ab7b42714153904dd678aac2bbbc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.818602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b062a-e265-44c4-8ddc-ee979bd92771 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:03.818769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c369ab7b42714153904dd678aac2bbbc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:03.822493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:03.825566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:03.827152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:03.853725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:03.855692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:03.856745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:03.857267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:03.860947 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:03.886993 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 721/1433] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:40:03.893817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:03.980989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c369ab7b42714153904dd678aac2bbbc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:03.983428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857687-aee4-4de8-a527-e94abf9f3b9e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:03.984576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c369ab7b42714153904dd678aac2bbbc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:04.005641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:04.008296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:04.020764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:04.020764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:04.020764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:04.020764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1e1c3-bcfc-416e-9ad0-b7d787b5eb40 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:04.025486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c369ab7b42714153904dd678aac2bbbc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:04.044207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c369ab7b42714153904dd678aac2bbbc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:04.045916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c369ab7b42714153904dd678aac2bbbc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:04.068375 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 713/1434] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:03 2022] DELETE /identity/v3/users/c369ab7b42714153904dd678aac2bbbc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:04.145985 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 722/1435] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:03 2022] POST /identity/v3/projects => generated 371 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:04.150573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:04.152918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:04.400172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:04.479528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39bd7-506b-4a83-9d7b-42a9df29cebf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:04.627297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:04.628173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:04.628800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:04.655994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:04.656817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:04.657198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:04.661675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:04.662549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:04.664680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:04.673874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] MFA Rules not processed for user `5f9a55c605f04f478d0a71679d8bf6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:04.677228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:04.738101 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 714/1436] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:04 2022] POST /identity/v3/users => generated 286 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:04.739289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:04.764254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd010-49d3-435a-b913-5b18aebbc26b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:04.780092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:04.780917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:04.781307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:04.781686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:04.782465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:04.784288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:04.816497 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 715/1437] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:04.817852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:04.839347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff0d9-dcf8-439a-9b00-12e3fb95dc3f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:04.842951 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 723/1438] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:04.871903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:04.874092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:04.874921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:04.876154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:04.876985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:04.885865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5d8b-3639-4b97-b9a9-8816fc8ec595 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:04.952163 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 716/1439] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:04.953422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:05.003140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fc2fd-2f14-4e9a-b299-d0612bd486e8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:05.024825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:05.028830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:05.033574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:05.034118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] PATH_INFO: `/v3/projects/ecebdf4a04264c3f9714ef472499bfcd/users/1bb30877e1df40f68a427d92d954bde2/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:05.102023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecebdf4a04264c3f9714ef472499bfcd, user_id=1bb30877e1df40f68a427d92d954bde2, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:05.105393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:05.138461 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 724/1440] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:04 2022] PUT /identity/v3/projects/ecebdf4a04264c3f9714ef472499bfcd/users/1bb30877e1df40f68a427d92d954bde2/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:05.140667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:05.141083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:05.141494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:05.287330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] MFA Rules not processed for user `1bb30877e1df40f68a427d92d954bde2`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:05.288863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:05.499884 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 717/1441] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:05.508881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:05.737244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddc07c-b320-44a8-9275-b78dae5f8210 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:05.776018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:05.778062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:05.778062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:05.778062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:05.778062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:05.785246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:05.884143 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 725/1442] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:05 2022] POST /identity/v3/projects => generated 371 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:05.886128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:05.908244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b609b59-2c55-45a5-8567-c54edeffd360 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:06.055236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:06.075923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:06.078005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:06.078271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:06.078546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:06.079284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:06.082266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:06.162021 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 718/1443] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:05 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:06.166304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:06.214401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f168d-0e37-44c4-a428-93e9c9e1c155 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:06.235484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:06.240524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:06.240849 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:06.241134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:06.241944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:06.243779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:06.327653 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 726/1444] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:06.328865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:06.364846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897719-02d9-4633-b2ba-ef5144f8a45d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:06.370178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:06.370861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:06.371141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:06.371417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] PATH_INFO: `/v3/projects/bcf0a38a37d4492186e1ce19f8076a73/users/694b63f0c6ec4c2cb394ce410bbd5ae2/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:06.425129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf0a38a37d4492186e1ce19f8076a73, user_id=694b63f0c6ec4c2cb394ce410bbd5ae2, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:06.433867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:06.471597 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 719/1445] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:06 2022] PUT /identity/v3/projects/bcf0a38a37d4492186e1ce19f8076a73/users/694b63f0c6ec4c2cb394ce410bbd5ae2/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:06.487888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:06.525327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4e320-3d06-4239-9501-c580114c9e87 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:06.551053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:06.834560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:06.837034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:06.854045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:06.855000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:06.860299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:06.861750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:06.864748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:06.866698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:06.915304 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 727/1446] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:06.917164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:06.943913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4655c-d9a2-4432-acb7-90afb9f9b662 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:06.957826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:06.958790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:06.959229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:06.959641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] PATH_INFO: `/v3/projects/bcf0a38a37d4492186e1ce19f8076a73/users/694b63f0c6ec4c2cb394ce410bbd5ae2/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:06.962872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf0a38a37d4492186e1ce19f8076a73, user_id=694b63f0c6ec4c2cb394ce410bbd5ae2, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:06.965823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6bd2-20df-48b0-883d-2c8416ceb674 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:06.991465 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 728/1447] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:06 2022] PUT /identity/v3/projects/bcf0a38a37d4492186e1ce19f8076a73/users/694b63f0c6ec4c2cb394ce410bbd5ae2/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:07.003066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:07.003756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:07.004205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:07.075666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] MFA Rules not processed for user `694b63f0c6ec4c2cb394ce410bbd5ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:07.077777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:07.135918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0464-3752-43b5-9b53-33d1063793c5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:07.289605 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 729/1448] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:07.302068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:07.303644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:07.410123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:07.410781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:07.411066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:07.411336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] PATH_INFO: `/v3/projects/3c0aab841db144c5a42315acc80572cc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:07.422210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0aab841db144c5a42315acc80572cc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:07.430077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:07.433590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b15ab-c6db-4c05-95cc-0b4f693a7984 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:07.445490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:07.446125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:07.446406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:07.446677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:07.479068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:07.480696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125fa3-36b0-45c0-970e-8efde086a0fc service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:07.524266 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 730/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:07.572188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0aab841db144c5a42315acc80572cc', 'request_id': 'req-0202d2f3-0030-4449-bcde-5412dbb14a22'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:07.586061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0aab841db144c5a42315acc80572cc', 'request_id': 'req-0202d2f3-0030-4449-bcde-5412dbb14a22'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:07.604745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0aab841db144c5a42315acc80572cc', 'request_id': 'req-0202d2f3-0030-4449-bcde-5412dbb14a22'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:07.611631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:07.635133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] The token cache is being invalidate because project 3c0aab841db144c5a42315acc80572cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:07.635305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:07.636906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0202d2f3-0030-4449-bcde-5412dbb14a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:07.644039 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 720/1450] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:06 2022] DELETE /identity/v3/projects/3c0aab841db144c5a42315acc80572cc => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:07.649424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:07.649937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:07.650577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:07.714756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:07.716058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:07.767011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:07.934048 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 731/1451] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:07.942776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:07.943242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:07.943699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.012965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:08.022829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:08.066020 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 721/1452] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:08.073249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.087491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061eb92-b057-41b6-ac72-7f65538a2cdd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.119015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.119609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.119928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.120185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.120848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:08.121156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.122803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.187090 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 732/1453] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:08.188366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.200012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80478fba-f9f5-4513-90ab-b2232985f38c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.224415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.226027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.227781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.230799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.237243 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.247524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.349331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.351418 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 722/1454] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:08 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:08.377971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebdc7-31b8-4090-aa9c-be5071b03f30 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.586315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.587390 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.589264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.589762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.592842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.603698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.605678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:08.629593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.645767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c82903-673f-4965-b9e2-717fc211d36b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.668381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.669023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.669318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.669588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] PATH_INFO: `/v3/users/1bb30877e1df40f68a427d92d954bde2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.673578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb30877e1df40f68a427d92d954bde2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.684626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.697905 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 733/1455] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:08 2022] POST /identity/v3/users => generated 288 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:08.703957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.752401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefe042-3032-4383-a3ae-aeddbb75c5f4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.771094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.773551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.773551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.773551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.774284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.776481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.811708 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 734/1456] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:08.816619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.849372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb30877e1df40f68a427d92d954bde2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:08.850740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb30877e1df40f68a427d92d954bde2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:08.874215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805fcd-498e-4038-a240-269cf9f9700e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:08.879185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb30877e1df40f68a427d92d954bde2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:08.884607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:08.885229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.885510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.886112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.886759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:08.890966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:08.909326 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 735/1457] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:08.913070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:08.918154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb30877e1df40f68a427d92d954bde2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:08.919079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d5ce61b3-4d35-46d1-97ab-0e1b116da851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb30877e1df40f68a427d92d954bde2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:08.931835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:08.955226 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 723/1458] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:08 2022] DELETE /identity/v3/users/1bb30877e1df40f68a427d92d954bde2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:08.956891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccac0-479f-4641-a145-4c1da36d48f1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:08.957367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccac0-479f-4641-a145-4c1da36d48f1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:08.957802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccac0-479f-4641-a145-4c1da36d48f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:08.985120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6017-a14d-46fd-8f88-2866cfe29a00 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:09.056543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c24ccac0-479f-4641-a145-4c1da36d48f1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:09.061977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c24ccac0-479f-4641-a145-4c1da36d48f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.202315 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 724/1459] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:09.207300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d131-4f06-4b0c-92a3-4bf37e4a92ff None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.207814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d131-4f06-4b0c-92a3-4bf37e4a92ff None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.208334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d131-4f06-4b0c-92a3-4bf37e4a92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.211040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:09.213554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.213842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.216085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] PATH_INFO: `/v3/projects/6821353e89b3428da498f1eba7cc0b47/users/4d8c170541714155b439a281c726b366/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.274991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3bb3d131-4f06-4b0c-92a3-4bf37e4a92ff None None] MFA Rules not processed for user `aacade278860491a9eac6f86b9b2a319`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:09.279202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3bb3d131-4f06-4b0c-92a3-4bf37e4a92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.282352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6821353e89b3428da498f1eba7cc0b47, user_id=4d8c170541714155b439a281c726b366, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:09.299332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:09.306405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:09.340158 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 736/1460] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:08 2022] PUT /identity/v3/projects/6821353e89b3428da498f1eba7cc0b47/users/4d8c170541714155b439a281c726b366/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:09.345597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:09.352913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.397188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:09.463140 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 725/1461] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:09.470503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.470982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.471317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.523430 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] MFA Rules not processed for user `4d8c170541714155b439a281c726b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:09.525318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.559146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2dae7-157f-4d3c-825f-460b5f0dc5ae admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:09.571233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:09.571965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.572460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.572928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.696140 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 726/1462] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:09.699468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:09.707902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.772721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:09.774190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:09.827805 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 737/1463] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:09.838230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:09.844175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:09.898331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af728-9ead-44d3-89b3-5e2f41028ebd service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:09.899739 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429845e8-2c1b-4dd5-bec3-590fbf820a95 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:09.912095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:09.913117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.913666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:09.914022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.914516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:09.914961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] PATH_INFO: `/v3/projects/a32b2b16745c485dbbb84a17b76619b3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.915584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:09.916648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:09.921168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32b2b16745c485dbbb84a17b76619b3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:09.926975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:09.935014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:09.939434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684273-b793-47eb-99dd-8006b594f49c service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:09.968600 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 727/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:10.085015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32b2b16745c485dbbb84a17b76619b3', 'request_id': 'req-bfe22f99-7ac7-4cbb-b87a-b5263d917608'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:10.109559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32b2b16745c485dbbb84a17b76619b3', 'request_id': 'req-bfe22f99-7ac7-4cbb-b87a-b5263d917608'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:10.116499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32b2b16745c485dbbb84a17b76619b3', 'request_id': 'req-bfe22f99-7ac7-4cbb-b87a-b5263d917608'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:10.134092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] The token cache is being invalidate because project a32b2b16745c485dbbb84a17b76619b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:10.134375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:10.135418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bfe22f99-7ac7-4cbb-b87a-b5263d917608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:10.137288 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 738/1465] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:09 2022] DELETE /identity/v3/projects/a32b2b16745c485dbbb84a17b76619b3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:10.144124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.144610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.145019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.209167 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:10.224844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:10.349710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f49a7-04e2-4693-acfd-ac4cde1c359d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.350217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f49a7-04e2-4693-acfd-ac4cde1c359d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.350701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f49a7-04e2-4693-acfd-ac4cde1c359d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.353062 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 739/1466] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:40:10.400674 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 728/1467] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:10.402241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.402692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.403182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.462985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:10.467435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:10.498024 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 740/1468] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:10.502791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:10.518271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b703ee-9698-4282-b13b-2f1953522298 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:10.534102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:10.535273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.535906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.536465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.537420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:10.537964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:10.542168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445913af-b8df-481d-8a22-df1152a8a9f2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:10.575214 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 729/1469] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:10.578918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:10.590564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebbe52-3f57-462e-9bb1-b2d8cdfb15d0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:10.600308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:10.601199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.601199 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.601533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.602102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:10.604073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:10.701752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:10.720546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:10.720902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:10.721418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:10.738460 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 741/1470] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:10 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:10.740951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:10.745187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:10.786457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:10.789730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:11.093464 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 730/1471] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:11.144050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d229-ba06-4c7a-9bfc-ba181c0da9cc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:11.172412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:11.173098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:11.173385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:11.177534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:11.179651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:11.189263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:11.255961 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 742/1472] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:10 2022] POST /identity/v3/users => generated 291 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:11.256702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:11.273627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57771e8-71a6-4f9c-b98e-be549af79dc1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:11.283071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:11.283721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:11.284022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:11.286449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:11.287192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:11.288913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:11.323337 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 731/1473] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:11.328620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:11.352030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33053ef-3b89-4739-b2ee-1182c33b1e56 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:11.370853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:11.371548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:11.371769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:11.377709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:11.378529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:11.380385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b451-5077-4e60-8385-7732f0be6b7f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:11.407899 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 743/1474] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:11.412059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:11.426950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae3bfa-11fd-458e-b53f-0bf7033dfb76 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:11.456160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:11.457372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:11.458530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:11.483809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] PATH_INFO: `/v3/projects/26102596938b407a99d9d419923d24e0/users/ef7545e80d204007b56bba256e8647d2/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:11.545504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26102596938b407a99d9d419923d24e0, user_id=ef7545e80d204007b56bba256e8647d2, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:11.551766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:11.583980 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 732/1475] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:11 2022] PUT /identity/v3/projects/26102596938b407a99d9d419923d24e0/users/ef7545e80d204007b56bba256e8647d2/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:11.596936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:11.597474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:11.598074 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:11.695192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] MFA Rules not processed for user `ef7545e80d204007b56bba256e8647d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:11.696734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:11.887190 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 744/1476] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:11.889119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.070183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ab65-dfe5-4e7c-af10-b171ecda5f4d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.083471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.084405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.084907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.085375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.086752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.088973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.183266 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 733/1477] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:11 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:12.185354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.200704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb365-591f-4b9e-9c43-ff3cdd742b61 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.293506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.294985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.295274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.295554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.299589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.303687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.337672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:12.354492 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 745/1478] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:12 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:12.359664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.374411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2f8a-5f6e-4da8-abd7-9a57b5937278 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.398950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.399588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.399889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.400229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.404716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.407809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.449833 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 734/1479] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:12.455467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.499953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f41eb-0e5c-43e1-b2c4-dfe9726de7d5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.532827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.533823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.535478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.536102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] PATH_INFO: `/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf/users/d5e979135c8148a1b3998b8069aa7ace/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.574971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.576909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ef12ec9f5d40fe849bdc85ecf59dbf, user_id=d5e979135c8148a1b3998b8069aa7ace, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.577255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:12.581326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.605496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50717015-de68-48c8-873d-e71f01b9ec0b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.607913 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 746/1480] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:12 2022] PUT /identity/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf/users/d5e979135c8148a1b3998b8069aa7ace/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:12.612209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.683448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:12.740850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.741772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.742696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.743098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] PATH_INFO: `/v3/projects/ecebdf4a04264c3f9714ef472499bfcd` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.745058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecebdf4a04264c3f9714ef472499bfcd)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.749922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.755914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8d9cf-765f-44e4-a6e3-665d45f9786e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.790813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.791453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.791737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.798448 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.799128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.800933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.819776 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 747/1481] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:12.820820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:12.836949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50aae-9bee-4437-9286-15a485437ea5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:12.854866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:12.855545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.855825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.857041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] PATH_INFO: `/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf/users/d5e979135c8148a1b3998b8069aa7ace/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.879918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ef12ec9f5d40fe849bdc85ecf59dbf, user_id=d5e979135c8148a1b3998b8069aa7ace, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:12.886589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d3e8-b666-4ff6-8ff9-35af4dbc1a99 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:12.910684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecebdf4a04264c3f9714ef472499bfcd', 'request_id': 'req-7d02f14c-fb8b-462d-868f-538967ecc947'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:12.942441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecebdf4a04264c3f9714ef472499bfcd', 'request_id': 'req-7d02f14c-fb8b-462d-868f-538967ecc947'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:12.949360 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 748/1482] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:12 2022] PUT /identity/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf/users/d5e979135c8148a1b3998b8069aa7ace/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:12.957246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ca8b-dd67-406a-b8ae-67370913ba06 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.957713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ca8b-dd67-406a-b8ae-67370913ba06 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.960060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ca8b-dd67-406a-b8ae-67370913ba06 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:12.968486 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 749/1483] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:40:12 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:40:12.972136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:12.972992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecebdf4a04264c3f9714ef472499bfcd', 'request_id': 'req-7d02f14c-fb8b-462d-868f-538967ecc947'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:12.974492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:12.975899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:13.033740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] The token cache is being invalidate because project ecebdf4a04264c3f9714ef472499bfcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:13.037353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.042469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7d02f14c-fb8b-462d-868f-538967ecc947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.050106 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 735/1484] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:12 2022] DELETE /identity/v3/projects/ecebdf4a04264c3f9714ef472499bfcd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:13.057481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:13.058671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:13.060168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:13.148297 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:13.152144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.180283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] MFA Rules not processed for user `d5e979135c8148a1b3998b8069aa7ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:13.191581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.340067 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 736/1485] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:13.341171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:13.345138 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.510419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:13.534867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db160247-2260-4b59-80c5-9ad9868fa9ae None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:13.541254 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 750/1486] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:13.544333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:13.547955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.569720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:13.570307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:13.570598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:13.570882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] PATH_INFO: `/v3/users/694b63f0c6ec4c2cb394ce410bbd5ae2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:13.575516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694b63f0c6ec4c2cb394ce410bbd5ae2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:13.578840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:13.603997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26588217-f926-4983-ae9f-6a8dc99f6d28 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:13.625141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:13.626504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:13.626504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:13.626977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:13.630952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.672994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694b63f0c6ec4c2cb394ce410bbd5ae2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.674938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694b63f0c6ec4c2cb394ce410bbd5ae2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.676496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:13.678978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:13.688008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694b63f0c6ec4c2cb394ce410bbd5ae2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.712803 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 751/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:13.713819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:13.716237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694b63f0c6ec4c2cb394ce410bbd5ae2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.718024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694b63f0c6ec4c2cb394ce410bbd5ae2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:13.721410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:13.750658 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 737/1488] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:13 2022] DELETE /identity/v3/users/694b63f0c6ec4c2cb394ce410bbd5ae2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:13.805918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:13.895503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ae2e5-951a-4999-be59-89d57afb7a0d service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:14.048489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:14.049785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:14.050205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:14.050820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:14.056076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:14.269398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:14.273549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:14.329108 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 752/1489] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:14.490234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:14.491810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:14.532054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac3f3-427e-4c04-9b89-d1a454bef489 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:14.551052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:14.551878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:14.555712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:14.558052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:14.569608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:14.627137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:14.628699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:14.786944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:14.789511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:14.836506 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 738/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:14.865962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e9f5-5457-4934-96af-b16cc30e4e8b service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:14.893335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:14.894471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:14.894892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:14.895398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:14.898404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:14.927644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:14.930409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:14.949789 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 753/1491] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:15.004009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.005973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.170970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd766-1763-4668-a646-407da7b9f5e5 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.176950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.177851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.178359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.178844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] PATH_INFO: `/v3/users/4d8c170541714155b439a281c726b366` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.180259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8c170541714155b439a281c726b366)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.182561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.230157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:15.272258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.273895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.286583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8c170541714155b439a281c726b366'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.288295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8c170541714155b439a281c726b366'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.301012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f440-3907-4fb0-9d9e-4b98d208391e service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.305913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8c170541714155b439a281c726b366'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.312174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.315306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.315765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.317163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] PATH_INFO: `/v3/users/ef7545e80d204007b56bba256e8647d2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.321616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7545e80d204007b56bba256e8647d2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.329868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.341241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8c170541714155b439a281c726b366'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.342733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8c170541714155b439a281c726b366'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.361254 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 739/1492] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:15 2022] DELETE /identity/v3/users/4d8c170541714155b439a281c726b366 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:15.362298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.363769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.365602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:15.409373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7545e80d204007b56bba256e8647d2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.410141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7545e80d204007b56bba256e8647d2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.410884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7545e80d204007b56bba256e8647d2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.420668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7545e80d204007b56bba256e8647d2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.441567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a7f8c3ae-057b-4498-82a7-326cbea87711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7545e80d204007b56bba256e8647d2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.465760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b480-8cbd-401d-9d66-6b4985cbc26f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.470973 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 754/1493] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:15 2022] DELETE /identity/v3/users/ef7545e80d204007b56bba256e8647d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:15.470973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f726c-959b-4153-86bb-d773891a6e73 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.470973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f726c-959b-4153-86bb-d773891a6e73 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.470973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f726c-959b-4153-86bb-d773891a6e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.472786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.473919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.473919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.474166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] PATH_INFO: `/v3/projects/bcf0a38a37d4492186e1ce19f8076a73` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.475532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf0a38a37d4492186e1ce19f8076a73)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.477843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.507470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b79f726c-959b-4153-86bb-d773891a6e73 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:15.512688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b79f726c-959b-4153-86bb-d773891a6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.542732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf0a38a37d4492186e1ce19f8076a73', 'request_id': 'req-508380bb-ea07-4d85-87fa-78dc829a84f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.551386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf0a38a37d4492186e1ce19f8076a73', 'request_id': 'req-508380bb-ea07-4d85-87fa-78dc829a84f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.560246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf0a38a37d4492186e1ce19f8076a73', 'request_id': 'req-508380bb-ea07-4d85-87fa-78dc829a84f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.579752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] The token cache is being invalidate because project bcf0a38a37d4492186e1ce19f8076a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:15.581642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.583456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-508380bb-ea07-4d85-87fa-78dc829a84f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:15.587925 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 740/1494] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:15 2022] DELETE /identity/v3/projects/bcf0a38a37d4492186e1ce19f8076a73 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:15.589645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da93-4f82-4746-a457-9a37d08ec12c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.590134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da93-4f82-4746-a457-9a37d08ec12c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.590898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da93-4f82-4746-a457-9a37d08ec12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.599409 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 755/1495] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:15.605230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.605519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.605787 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.633364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:15.634823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.672782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fed8da93-4f82-4746-a457-9a37d08ec12c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:15.675209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fed8da93-4f82-4746-a457-9a37d08ec12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.707676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:15.734883 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 756/1496] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:15.740696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.742352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.764570 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 741/1497] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:15.766130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.766552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.767101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.779771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:15.803554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:15.804847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:15.819045 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 742/1498] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:15.819952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.821443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e620-b315-4869-84be-b36cd03f4686 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.826117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.826776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.827063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.827316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.837323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c186d-0c49-4261-9cb0-8e71328551db None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.837516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.838953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.843224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.844069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.844618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.845108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.851511 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 757/1499] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:15.852553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.858525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.860788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.864980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b1ea1-e868-4742-8eb0-183618b6e71a service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.870757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.871441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.871725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.872031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.872836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:15.873237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.875223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.884050 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 743/1500] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:15.890882 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 758/1501] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:15.895356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.907522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cc8d-3e2a-455a-a6a7-306839efa563 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:15.923773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:15.924342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:15.924622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:15.924942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:15.925658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:15.927655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:15.979218 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 744/1502] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:15.985378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:15.995647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e763d3e-63fa-45d0-8a8e-3bc1ee6d8317 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.084012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.084791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.085135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.085480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.086200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.089745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.124396 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 759/1503] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:15 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:16.126442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.139401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca1ba-2ff3-4e11-a32d-d60fe8e9e652 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.146125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.146887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.147225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.147653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.148664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.150525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.167497 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 745/1504] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:16.168618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.179565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b61fd-bd5e-47c8-8d87-5f1f46a4e095 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.184414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.185628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.185628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.186056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.186805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.188590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791402b7-6ad8-4b3a-9d58-2ae5198f52be admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.199127 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 760/1505] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:16.203836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.215014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed469-efcf-456b-a8aa-bdfaf4bceef1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.220580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.221306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.221656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.222002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] PATH_INFO: `/v3/projects/38c8b652b6794a77a8ee7fcc539e7930/users/eb064b9313734098971910d1c6d9dad5/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.241627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c8b652b6794a77a8ee7fcc539e7930, user_id=eb064b9313734098971910d1c6d9dad5, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.244398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.266066 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 746/1506] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:16 2022] PUT /identity/v3/projects/38c8b652b6794a77a8ee7fcc539e7930/users/eb064b9313734098971910d1c6d9dad5/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:16.277896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.278257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.278628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.313145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] MFA Rules not processed for user `eb064b9313734098971910d1c6d9dad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:16.314459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.400458 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 761/1507] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:16.409664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.441821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.443453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.510011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:16.524631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468c7d0-122e-4c4d-a632-354ff4d57312 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.532087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.532702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.532981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.533248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.534178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.535798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.551329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf231ae-975a-4b27-9663-9c300d64ca23 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.556094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.556719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.557155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.557394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] PATH_INFO: `/v3/projects/6821353e89b3428da498f1eba7cc0b47` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.558544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6821353e89b3428da498f1eba7cc0b47)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.561041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.568066 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 747/1508] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:16 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:16.568984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.571526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.613259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:16.618699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6821353e89b3428da498f1eba7cc0b47', 'request_id': 'req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.625855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6821353e89b3428da498f1eba7cc0b47', 'request_id': 'req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.632881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6821353e89b3428da498f1eba7cc0b47', 'request_id': 'req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.646462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] The token cache is being invalidate because project 6821353e89b3428da498f1eba7cc0b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:16.647101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.647214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048869f6-b9d5-48c8-a32f-18b25cb6d4fb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.647397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.648936 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 762/1509] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:16 2022] DELETE /identity/v3/projects/6821353e89b3428da498f1eba7cc0b47 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:16.652339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.652339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.734640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.735987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.736343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.736615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] PATH_INFO: `/v3/projects/26102596938b407a99d9d419923d24e0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.737770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26102596938b407a99d9d419923d24e0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.739711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.740128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1aac-d16a-4696-b86f-ee3cd8a792b5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:16.745949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:16.747174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.747626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.749047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.749848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:16.752517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e702b-d0a1-4ac8-8bc8-e8230e35b95b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:16.828544 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 763/1510] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:16 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:16.828901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26102596938b407a99d9d419923d24e0', 'request_id': 'req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.829819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:16.830443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:16.830770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:16.844140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26102596938b407a99d9d419923d24e0', 'request_id': 'req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.853069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26102596938b407a99d9d419923d24e0', 'request_id': 'req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.863949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:16.866877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.882505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] The token cache is being invalidate because project 26102596938b407a99d9d419923d24e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:16.882745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.887705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:16.895381 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 748/1511] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:16 2022] DELETE /identity/v3/projects/26102596938b407a99d9d419923d24e0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:16.896426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.898094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.950980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:16.980634 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 764/1512] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:16.981794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:16.984128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:16.999670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40acac-4556-49d4-a983-6c0046399ca9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.009786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.010659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.011005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.011731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] PATH_INFO: `/v3/users/d5e979135c8148a1b3998b8069aa7ace` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.013564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e979135c8148a1b3998b8069aa7ace)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.015983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.028701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30af8-4395-4535-9cf0-89b3a4cc71d5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.034299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.035408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.035755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.036173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.037116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.039003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8093d-f25e-49e2-9bf8-86355b86cb9e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.060024 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 749/1513] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:17.062835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.063194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.063545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.086662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:17.095605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:17.097855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.105953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e979135c8148a1b3998b8069aa7ace'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.106826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e979135c8148a1b3998b8069aa7ace'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.108262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e979135c8148a1b3998b8069aa7ace'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.110355 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 750/1514] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:17.111481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.121183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e979135c8148a1b3998b8069aa7ace'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.126213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d4a4-2590-4966-9e5b-fa8f35b6de8e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.131508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.132360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.132702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.133044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] PATH_INFO: `/v3/projects/7888a29240be4fe794db13284979fca0/users/c053f4bf5f1f48b7b39aeb00fc37af96/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.138804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e979135c8148a1b3998b8069aa7ace'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.152361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7888a29240be4fe794db13284979fca0, user_id=c053f4bf5f1f48b7b39aeb00fc37af96, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.155713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.172048 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 765/1515] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:16 2022] DELETE /identity/v3/users/d5e979135c8148a1b3998b8069aa7ace => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:17.172988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.174424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.199663 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 751/1516] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:17 2022] PUT /identity/v3/projects/7888a29240be4fe794db13284979fca0/users/c053f4bf5f1f48b7b39aeb00fc37af96/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:17.205187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.209320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.316299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b52ab-25cd-49b7-8080-85b4520eb0cb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.349582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3453-ce6a-4c53-886d-10fa55e9a732 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.361341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.363342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.365292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.365995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.366922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.373024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.407991 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 752/1517] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:17.419352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.429963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.430650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.430935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.431291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.432014 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:17.432412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.435752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559227b-a03b-4778-9fe2-b5789ebbb35f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.438054 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.443139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.444117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.444606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.445598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] PATH_INFO: `/v3/projects/7888a29240be4fe794db13284979fca0/users/c053f4bf5f1f48b7b39aeb00fc37af96/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.449124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7888a29240be4fe794db13284979fca0, user_id=c053f4bf5f1f48b7b39aeb00fc37af96, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.452110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf3c60-3ad1-4ec4-a87d-575053a0a25c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.473461 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 766/1519] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:17.474720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.477379 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 753/1519] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:17 2022] PUT /identity/v3/projects/7888a29240be4fe794db13284979fca0/users/c053f4bf5f1f48b7b39aeb00fc37af96/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:17.478863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801780a-639a-4742-a374-b229309d45db None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.479178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801780a-639a-4742-a374-b229309d45db None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.479407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801780a-639a-4742-a374-b229309d45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.491275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:17.501712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3199aa-6ef5-450b-880c-3f50148aee72 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.520622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5801780a-639a-4742-a374-b229309d45db None None] MFA Rules not processed for user `c053f4bf5f1f48b7b39aeb00fc37af96`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:17.522199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5801780a-639a-4742-a374-b229309d45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.588725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.589632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.590060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.590488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.591256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.594029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.621079 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 754/1520] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:17.631730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801780a-639a-4742-a374-b229309d45db None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.633342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5801780a-639a-4742-a374-b229309d45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.636364 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 767/1521] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:17 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:17.641943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.693307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:17.707382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801780a-639a-4742-a374-b229309d45db None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.725593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21337-b45d-42ec-b8cd-967bc12bccf8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.735277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.736484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.736971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.737475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.738972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.741660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.764213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.765582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.765861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.766313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.778147 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 768/1522] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:17 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:17.782623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.807900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96635d-fc28-4642-9b01-0cdd08499449 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.807900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.807900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.807900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.808324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.808324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.809098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.821306 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 769/1523] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:17.825212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.839113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cd45-ea13-4a9f-a4e2-4112a2533f18 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.848139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.850552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.856838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.858222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.858505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.858777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.860459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.862789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.866278 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 755/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:17.867239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.869292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:17.880313 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 770/1525] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:17.881345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.895219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5017f-d201-4473-b8b5-761330666a9d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.902687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.904195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.904931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.905206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] PATH_INFO: `/v3/projects/d3a31de5be1843f181484a36cf584c2f/users/ed8c055ddd754c2e97f4fd306722875b/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.907840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cff5-716c-4a13-8ab5-0bff83cffe7b service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:17.914361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:17.915804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:17.916133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:17.916408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] PATH_INFO: `/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:17.928550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ef12ec9f5d40fe849bdc85ecf59dbf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.930551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.930952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a31de5be1843f181484a36cf584c2f, user_id=ed8c055ddd754c2e97f4fd306722875b, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:17.934540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:17.953551 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 771/1526] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:17 2022] PUT /identity/v3/projects/d3a31de5be1843f181484a36cf584c2f/users/ed8c055ddd754c2e97f4fd306722875b/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:17.954726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:17.990324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ef12ec9f5d40fe849bdc85ecf59dbf', 'request_id': 'req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:17.997277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:17.998402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ef12ec9f5d40fe849bdc85ecf59dbf', 'request_id': 'req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.006467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ef12ec9f5d40fe849bdc85ecf59dbf', 'request_id': 'req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.022246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] The token cache is being invalidate because project e7ef12ec9f5d40fe849bdc85ecf59dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:18.022536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.023175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ed7e04dd-78b0-4ae2-89a7-3689e0c2b20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.027913 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 756/1527] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:17 2022] DELETE /identity/v3/projects/e7ef12ec9f5d40fe849bdc85ecf59dbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:18.027913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06de34-7985-40c2-99ee-262dffc7fd82 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.027913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06de34-7985-40c2-99ee-262dffc7fd82 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.027913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06de34-7985-40c2-99ee-262dffc7fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.035493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e484d-eb8f-468c-8812-40129595d8b3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.057263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9b06de34-7985-40c2-99ee-262dffc7fd82 None None] MFA Rules not processed for user `ed8c055ddd754c2e97f4fd306722875b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:18.058687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b06de34-7985-40c2-99ee-262dffc7fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.086495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:18.106159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.106784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.107059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.108123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] PATH_INFO: `/v3/users/eb064b9313734098971910d1c6d9dad5` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.109441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb064b9313734098971910d1c6d9dad5)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.111415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.146367 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 757/1528] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:18.148063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.148545 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.149191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.172207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:18.173435 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.177511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb064b9313734098971910d1c6d9dad5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.178289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb064b9313734098971910d1c6d9dad5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.178975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb064b9313734098971910d1c6d9dad5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.182553 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 758/1529] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:18.183370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.185011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.194800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb064b9313734098971910d1c6d9dad5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.197532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863debad-5432-4a04-a897-5e3aceb3baa2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.202736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.203192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-359436e1-f348-4239-8226-eb7d47e756ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb064b9313734098971910d1c6d9dad5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:18.203558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.203950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.204295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.205177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.207343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c00a16-e295-4073-9485-915a0b8fe18f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.229903 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 772/1530] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:17 2022] DELETE /identity/v3/users/eb064b9313734098971910d1c6d9dad5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:18.231613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.232128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.234043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.248958 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 759/1531] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:18.250326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.250676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.251021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.255145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:18.256179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.280814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:18.283349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.322043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:18.341468 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 773/1532] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:18.342360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.343778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.359822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e0b9d-6b4c-498b-8d5f-e332ed4c2cc9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.366050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.366722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.367006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.367414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.368094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.370047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.381559 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 760/1533] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:18.382430 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.392688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1401-275a-42f7-b13d-0f8e86e5d63a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.398672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.399431 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 774/1534] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:18.399652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.400123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.400425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.401038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:18.401338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.403002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.403141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.404762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.420756 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 761/1535] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:18.420756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.434793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8891b-605e-43a1-bcb1-5a643dc93129 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.442112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.443106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.443685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.444326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.444982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.446655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.459013 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 762/1536] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:18.459836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.469910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8bef-f4a3-4e1f-86dc-c57dbc0e00a3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.474585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.475218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.475454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.475722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.476385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.478284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.494971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a1e-b181-4496-a69c-517e0c46e14b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.500313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.500905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.501208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.501452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.512046 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 763/1537] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:18.512205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.515320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.516799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.526949 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 775/1538] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:18.527800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.549754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d413e8-3d7b-4d05-a73b-46f78a0c5ff8 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.580177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:18.601791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9af3-a27e-467c-b015-20282b713554 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.613006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.613006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.613006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.613006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.613465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.613465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.627424 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 764/1539] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:18.632816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.644058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.644265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb81d3-42d3-4915-a152-d94594dc2627 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.644850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.645127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.645397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.646081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.648674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.653166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.653853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.654217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.655692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] PATH_INFO: `/v3/projects/1fc966efc11a41fcb268dac2450241cb/users/b5a87c60874046f097ae8de76c422171/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.678515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc966efc11a41fcb268dac2450241cb, user_id=b5a87c60874046f097ae8de76c422171, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.680690 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 776/1540] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:18.684793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.685439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cf926-1f1b-4784-955a-a1d6b21cbc14 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.700722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1125ab-dfb2-47e5-b672-cbed9f8e7178 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.704936 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 765/1541] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:18 2022] PUT /identity/v3/projects/1fc966efc11a41fcb268dac2450241cb/users/b5a87c60874046f097ae8de76c422171/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:18.718278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.718419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.718619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.758481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] MFA Rules not processed for user `b5a87c60874046f097ae8de76c422171`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:18.759627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:18.821659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.822751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.823141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.823512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.824711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.827288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.843637 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 766/1542] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:18.844803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.847233 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 777/1543] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:18.848350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.856596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096575-c0dc-498f-bffa-4357856278e4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.860781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2d37d-e6d2-40da-a6de-cc524e6ed74e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.863083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.863948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.864381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.864805 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.865597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.867210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.867612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.868014 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.868468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.868808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.869525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.871619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.882565 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 767/1544] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:18.883288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:18.886586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.899734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ba81-7d95-4f7b-a767-2099f131b085 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:18.906869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:18.907704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:18.908116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:18.908491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] PATH_INFO: `/v3/projects/78099a2acb31422095531592b7c2da20/users/a76e5b2b9d844730bf0c955c1c47b582/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:18.924384 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 778/1545] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:18.927862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.929521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78099a2acb31422095531592b7c2da20, user_id=a76e5b2b9d844730bf0c955c1c47b582, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:18.933031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:18.956653 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 768/1546] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:18 2022] PUT /identity/v3/projects/78099a2acb31422095531592b7c2da20/users/a76e5b2b9d844730bf0c955c1c47b582/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:18.957730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:18.961313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.016988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a032-71c9-4e21-8608-0087be1c78d5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.039219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.039870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.040194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.040473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.041132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.043191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c2a6-d534-41fe-bf08-d2297123af83 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.046113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bd9c8-40ce-4f1c-a11d-faa7a8f5d114 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.050684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.051307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.051583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.051935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] PATH_INFO: `/v3/projects/38c8b652b6794a77a8ee7fcc539e7930` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.053031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c8b652b6794a77a8ee7fcc539e7930)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.055050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.069393 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 779/1547] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:18 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:19.069393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.069393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.069393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.073670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:19.089728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:19.090972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.105410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c8b652b6794a77a8ee7fcc539e7930', 'request_id': 'req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.111981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c8b652b6794a77a8ee7fcc539e7930', 'request_id': 'req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.118724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c8b652b6794a77a8ee7fcc539e7930', 'request_id': 'req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.131615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] The token cache is being invalidate because project 38c8b652b6794a77a8ee7fcc539e7930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:19.132181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.132824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.134357 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 769/1548] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:18 2022] DELETE /identity/v3/projects/38c8b652b6794a77a8ee7fcc539e7930 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:19.137278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.137278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.153843 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 780/1549] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:19.155441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.156743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.168341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff1903-80d3-4e17-bda4-c851096707aa None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.173825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.174451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.174730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.175026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] PATH_INFO: `/v3/users/c053f4bf5f1f48b7b39aeb00fc37af96` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.176188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c053f4bf5f1f48b7b39aeb00fc37af96)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.178121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.209105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57c5a1-abae-4bb9-b8ea-9ca88c2c76ce admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.214585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.215183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.215459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.215725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.216380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.219246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.227953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c053f4bf5f1f48b7b39aeb00fc37af96'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.228613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c053f4bf5f1f48b7b39aeb00fc37af96'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.229036 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 770/1550] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:19.229347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c053f4bf5f1f48b7b39aeb00fc37af96'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.229822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.231407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.237302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c053f4bf5f1f48b7b39aeb00fc37af96'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.244921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c053f4bf5f1f48b7b39aeb00fc37af96'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:19.253611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:19.267915 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 781/1551] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:19 2022] DELETE /identity/v3/users/c053f4bf5f1f48b7b39aeb00fc37af96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:19.269003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.270669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.302810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bbb1f-306c-499d-bf6e-616ddb068cce admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.350196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb075-9fd8-451d-a162-b5f21064d83d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.357503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.358909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.359654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.359972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] PATH_INFO: `/v3/projects/d475225bf5ed404cb20b95e525ec4316/users/392a599433674a19ada22a6561d7b9ed/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.364725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.365369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.365645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.365914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.367928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.382237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.382746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d475225bf5ed404cb20b95e525ec4316, user_id=392a599433674a19ada22a6561d7b9ed, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.384006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.385913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.390269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:19.396739 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 771/1552] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:19.407251 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 782/1553] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:19 2022] PUT /identity/v3/projects/d475225bf5ed404cb20b95e525ec4316/users/392a599433674a19ada22a6561d7b9ed/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:19.411185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.422166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5547-31ca-442d-ab65-53b2efb6a1d4 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.496375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.497116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.497489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.497853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.499109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.501517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fb688-9a35-4348-8145-bc0036b79fba admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.520523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.520790 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 772/1554] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:19.533782 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947118-c23e-4df7-ba3e-b62016127441 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.541455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.542174 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.542544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.542889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] PATH_INFO: `/v3/projects/d475225bf5ed404cb20b95e525ec4316/users/392a599433674a19ada22a6561d7b9ed/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.545726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d475225bf5ed404cb20b95e525ec4316, user_id=392a599433674a19ada22a6561d7b9ed, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:19.549665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:19.563094 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 783/1555] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:19 2022] PUT /identity/v3/projects/d475225bf5ed404cb20b95e525ec4316/users/392a599433674a19ada22a6561d7b9ed/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:19.578740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.579078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.579671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.633975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] MFA Rules not processed for user `392a599433674a19ada22a6561d7b9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:19.635289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.731710 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 773/1556] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:19.745165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:19.746941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:19.870156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3288-e336-4ed5-b1d3-844f496ebdac admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:19.876803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:19.876803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:19.876803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:19.877800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:19.882233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:20.013230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:20.016027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:20.028172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:20.032793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c9e8-9624-4c0b-8b39-989cdc08e031 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:20.068904 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 784/1557] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:20.157214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43620797-91c5-41ec-9bfb-8946cee03ca0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:20.172324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:20.173148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:20.173529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:20.173901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] PATH_INFO: `/v3/projects/7888a29240be4fe794db13284979fca0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:20.175645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7888a29240be4fe794db13284979fca0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:20.177863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:20.254525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:20.295820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7888a29240be4fe794db13284979fca0', 'request_id': 'req-1528b832-cd4c-4cfe-904d-8583dc5d9d08'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:20.304177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7888a29240be4fe794db13284979fca0', 'request_id': 'req-1528b832-cd4c-4cfe-904d-8583dc5d9d08'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:20.315347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7888a29240be4fe794db13284979fca0', 'request_id': 'req-1528b832-cd4c-4cfe-904d-8583dc5d9d08'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:20.337375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] The token cache is being invalidate because project 7888a29240be4fe794db13284979fca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:20.337773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:20.338886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1528b832-cd4c-4cfe-904d-8583dc5d9d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:20.341081 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 774/1558] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:20 2022] DELETE /identity/v3/projects/7888a29240be4fe794db13284979fca0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:20.346005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:20.346300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:20.346579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:20.390120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:20.391674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:20.410107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:20.569747 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 785/1559] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:20.577754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:20.578039 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:20.578315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:20.676353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:20.680461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:20.708955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:20.719735 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 775/1560] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:20.730912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4967f8c-f96b-4324-a08c-4da40e91a7a0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:20.752238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:20.753136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:20.754535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:20.755367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:20.758040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:20.759325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:20.761338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:20.808026 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 786/1561] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:20.812939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:20.844491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888000-6e58-4fd0-8b5f-0afc81561607 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:20.852534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:20.853335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:20.853717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:20.855993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:20.857732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:20.862628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:20.927328 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 776/1562] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:20 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:20.928611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:20.943559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68c83-b9ef-4a29-a15a-3d26e4da4aff admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.028177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.028953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.029352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.030435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.031176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.033409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.071429 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 787/1563] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:20 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:21.075370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.094379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208069-4fd8-49cd-9ba4-6e85ad521012 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.104140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.104990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.105485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.105807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.107059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.111999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.131969 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 777/1564] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:21.133398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.149266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724150-028a-4a76-9e30-c0b7dc36c795 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.157351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.158451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.159287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.159681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.160485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.163627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1e0a-e5fc-42ba-807d-4e56fcb25459 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.189522 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 788/1565] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:21.192547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.204527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0188-1b6b-4594-80dc-602a16e07cca admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.209289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.210052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.210432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.210796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] PATH_INFO: `/v3/projects/e758211c96b64af2a5b03c314edf5d39/users/0ce87922574a4c55b993a6f524422953/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.229339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e758211c96b64af2a5b03c314edf5d39, user_id=0ce87922574a4c55b993a6f524422953, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.232853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.251125 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 778/1566] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:21 2022] PUT /identity/v3/projects/e758211c96b64af2a5b03c314edf5d39/users/0ce87922574a4c55b993a6f524422953/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:21.282023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.283048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.283417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.330043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] MFA Rules not processed for user `0ce87922574a4c55b993a6f524422953`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:21.331581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:21.460419 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 789/1567] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:21.465513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.570688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2fb2-6085-4d68-a016-5d17303ac1f0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.579994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.581128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.582278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.582797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.583791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.587349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.666885 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 779/1568] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:21 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:21.672545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.693995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135882f-fd09-4ba8-80bd-6102b32c6ae2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.707020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:21.789148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.789905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.790173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.790446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.791090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.793172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72169cb-2204-4598-96e9-fcfe333c36f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.824313 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 790/1569] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:21 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:21.824403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.830205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.830530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.830912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.839632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0971a-cf9a-4c0d-b6ee-5cc5cadfe43a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.853626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.854246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.854530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.854845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.855554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.857277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.882601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] MFA Rules not processed for user `a76e5b2b9d844730bf0c955c1c47b582`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:21.883832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:21.885609 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 780/1570] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:21.890953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.913965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986822d-3daf-40be-9d68-36cf78502317 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:21.924309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:21.926977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:21.927495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:21.929198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] PATH_INFO: `/v3/projects/a657dbf2734344ce902a5579af5b82a6/users/ac51c747ec2b41c8828d0de37729bf2b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:21.962119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a657dbf2734344ce902a5579af5b82a6, user_id=ac51c747ec2b41c8828d0de37729bf2b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:21.964596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:21.978384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:21.988399 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 791/1571] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:21.991795 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 781/1572] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:21 2022] PUT /identity/v3/projects/a657dbf2734344ce902a5579af5b82a6/users/ac51c747ec2b41c8828d0de37729bf2b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:21.994272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.994485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:21.997245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:22.014217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd83c-55c6-41ff-81e4-f3d6ccb9225b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.072611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3894-7e45-4396-81fa-448dee24a16a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.077751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.078356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.078635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.078904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.079534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.081548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.108720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.108992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.109563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.109960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.110756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.112555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.116271 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 782/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:21 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:22.117051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.123892 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 792/1574] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:22.124253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.125882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:22.157506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:22.184547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6686-6265-4c42-b229-60e325db788f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.186749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc885f-963a-482b-b1da-3d34e6dc7cc3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.189908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.190516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.190825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.191094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.191731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.193708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.223313 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 783/1575] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:22 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:22.223313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.231142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0457-1718-40d3-9eaf-0fdb642e09b0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.236961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.237594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.237870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.238330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] PATH_INFO: `/v3/projects/a657dbf2734344ce902a5579af5b82a6/users/ac51c747ec2b41c8828d0de37729bf2b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.240250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a657dbf2734344ce902a5579af5b82a6, user_id=ac51c747ec2b41c8828d0de37729bf2b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.242913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.243811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.244515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.244868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.245240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.247358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:22.254571 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 784/1576] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:22 2022] PUT /identity/v3/projects/a657dbf2734344ce902a5579af5b82a6/users/ac51c747ec2b41c8828d0de37729bf2b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:22.255369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.323897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.325822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e87f-b26f-43fe-b87c-20b4a0dfd9fb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.326469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ecd0d-3e4d-47e0-ac90-99f68143fdb2 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.331960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.332226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.332499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.332774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.333411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.335009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.336590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:22.340508 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 793/1577] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:22.341700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.342668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.342988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.353124 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 785/1578] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:22.353776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.368947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da23e8-68e3-4fb6-b3ff-0c4ed2631403 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.374611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.375405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.375701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.376008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] PATH_INFO: `/v3/projects/0f515e217ddc434192f81acd16acd7e9/users/86c653c37aad46b49eaca8158da8f1d8/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.378270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] MFA Rules not processed for user `ac51c747ec2b41c8828d0de37729bf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:22.379734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:22.411642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f515e217ddc434192f81acd16acd7e9, user_id=86c653c37aad46b49eaca8158da8f1d8, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.415146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.436371 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 786/1579] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:22 2022] PUT /identity/v3/projects/0f515e217ddc434192f81acd16acd7e9/users/86c653c37aad46b49eaca8158da8f1d8/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:22.442474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.498095 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 794/1580] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:22.524410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.524410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:22.543409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061759f-44ac-4029-9e91-607e4423377f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.553639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.554263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.554543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.554812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.555547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.557870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.574210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:22.574596 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 787/1581] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:22.581547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.603658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810bb57-d4f4-45cb-a4d3-17219b2f1dae admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.619567 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.620272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.620562 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.620972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] PATH_INFO: `/v3/projects/0f515e217ddc434192f81acd16acd7e9/users/86c653c37aad46b49eaca8158da8f1d8/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.628241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f515e217ddc434192f81acd16acd7e9, user_id=86c653c37aad46b49eaca8158da8f1d8, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.632501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.639905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcabf-adfc-431f-9eab-e6e1dfc57743 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:22.660198 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 788/1582] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:22 2022] PUT /identity/v3/projects/0f515e217ddc434192f81acd16acd7e9/users/86c653c37aad46b49eaca8158da8f1d8/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:22.725628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:22.726252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.726628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.726795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.858181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:22.861002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713033f0-1659-42bc-9133-7b7f4cc710f1 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:22.874211 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 795/1583] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:22.956471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:22.957446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65889-3b51-41b9-bb16-219730bbcfbd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.957939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65889-3b51-41b9-bb16-219730bbcfbd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.958309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65889-3b51-41b9-bb16-219730bbcfbd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:22.960079 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 796/1584] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:40:22.980755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:22.981164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:22.981539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.027646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:23.031144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.079399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d500-2a36-4050-ac1e-df532f9c54bc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:23.090520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:23.093375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:23.093667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:23.095529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] PATH_INFO: `/v3/users/0ce87922574a4c55b993a6f524422953` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.097713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce87922574a4c55b993a6f524422953)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:23.100179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:23.196154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce87922574a4c55b993a6f524422953'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:23.197034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce87922574a4c55b993a6f524422953'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:23.211357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce87922574a4c55b993a6f524422953'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:23.214980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:23.226912 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 797/1585] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:23.241875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:23.243636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.260510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce87922574a4c55b993a6f524422953'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:23.262292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4fab0adf-df14-42c2-9692-5ded02d4ca7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce87922574a4c55b993a6f524422953'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:23.281444 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 789/1586] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:22 2022] DELETE /identity/v3/users/0ce87922574a4c55b993a6f524422953 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:23.286925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:23.287248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:23.287486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.297431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de6779-1e11-4c5f-be6f-19465bc38576 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:23.316164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:23.318728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.327820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:23.405813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:23.406359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:23.407158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:23.407158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.409541 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 790/1587] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:23.416583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:23.417593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:23.418552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.419183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:23.432040 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 798/1588] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:23.433830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:23.435193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.500268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcfda7-45ef-4926-a4da-07a35b7066ea None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:23.504607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:23.505501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:23.505760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:23.506187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.508537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:23.509506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fff83-7145-43f5-a50f-b00360dd306c service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:23.515206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:23.516321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:23.516605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:23.516876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:23.526840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:23.528323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63e646-45f7-4e78-aeda-a4eddacc2abc service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:23.546712 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 799/1589] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:23.592415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:23.594147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:23.612851 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 791/1590] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:24.088872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9d13-fb0d-49d3-9a69-60f29c64174d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:24.089375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9d13-fb0d-49d3-9a69-60f29c64174d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:24.089557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9d13-fb0d-49d3-9a69-60f29c64174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:24.137582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3ccf9d13-fb0d-49d3-9a69-60f29c64174d None None] MFA Rules not processed for user `86c653c37aad46b49eaca8158da8f1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:24.138823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3ccf9d13-fb0d-49d3-9a69-60f29c64174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.176866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:24.179636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.221722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349357fe-37b1-4524-8c21-a9dc87dd9a18 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:24.229305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:24.230222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:24.230719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:24.231130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] PATH_INFO: `/v3/projects/e758211c96b64af2a5b03c314edf5d39` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:24.233513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e758211c96b64af2a5b03c314edf5d39)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:24.235897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:24.254379 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 800/1591] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:24.266170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:24.266455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:24.266737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:24.280452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:24.293763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] MFA Rules not processed for user `a76e5b2b9d844730bf0c955c1c47b582`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:24.295394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.323340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e758211c96b64af2a5b03c314edf5d39', 'request_id': 'req-4497bfdb-313b-4f61-8f91-949052d21f6f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.331947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e758211c96b64af2a5b03c314edf5d39', 'request_id': 'req-4497bfdb-313b-4f61-8f91-949052d21f6f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.339733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e758211c96b64af2a5b03c314edf5d39', 'request_id': 'req-4497bfdb-313b-4f61-8f91-949052d21f6f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.356638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] The token cache is being invalidate because project e758211c96b64af2a5b03c314edf5d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:24.358268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.361437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.364542 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 792/1592] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:24 2022] DELETE /identity/v3/projects/e758211c96b64af2a5b03c314edf5d39 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:24.370895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:24.374510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:24.377664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.428086 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 801/1593] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:24.441037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:24.442517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.459723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47c8a-860c-48aa-862d-8120829f4370 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:24.489154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497bfdb-313b-4f61-8f91-949052d21f6f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:24.494570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:24.495292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:24.495645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:24.496016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] PATH_INFO: `/v3/users/ac51c747ec2b41c8828d0de37729bf2b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:24.497245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac51c747ec2b41c8828d0de37729bf2b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:24.500020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:24.538530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:24.539763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:24.540449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:24.540884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:24.554039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:24.558019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac51c747ec2b41c8828d0de37729bf2b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.559112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac51c747ec2b41c8828d0de37729bf2b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.572188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac51c747ec2b41c8828d0de37729bf2b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.590834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac51c747ec2b41c8828d0de37729bf2b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.592428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac51c747ec2b41c8828d0de37729bf2b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:24.617154 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 793/1594] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:24 2022] DELETE /identity/v3/users/ac51c747ec2b41c8828d0de37729bf2b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:24.672836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:24.674636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245de664-67a5-4c86-b967-3fa63aeeb759 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:24.700355 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 802/1595] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:25.019917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.021760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:25.082324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:25.164389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf8f2-859b-45b7-bef9-e85d6b7b33ef admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.174382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.175170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.175761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.179804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] PATH_INFO: `/v3/projects/a657dbf2734344ce902a5579af5b82a6` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.181357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a657dbf2734344ce902a5579af5b82a6)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.187708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.274152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a657dbf2734344ce902a5579af5b82a6', 'request_id': 'req-621e0e29-1d5d-4afd-9044-7602826b0083'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:25.283576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a657dbf2734344ce902a5579af5b82a6', 'request_id': 'req-621e0e29-1d5d-4afd-9044-7602826b0083'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:25.292610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a657dbf2734344ce902a5579af5b82a6', 'request_id': 'req-621e0e29-1d5d-4afd-9044-7602826b0083'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:25.319499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] The token cache is being invalidate because project a657dbf2734344ce902a5579af5b82a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:25.319834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:25.320518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-621e0e29-1d5d-4afd-9044-7602826b0083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:25.323567 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 794/1596] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:25 2022] DELETE /identity/v3/projects/a657dbf2734344ce902a5579af5b82a6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:25.330232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.330855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.330855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.370811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:25.376627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:25.468702 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 803/1597] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:25.480456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.480752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.481031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.509446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:25.510710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:25.519916 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 795/1598] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:25.523734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.534900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1b80-2a85-4e6f-8600-682ff8442b01 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.551132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.552791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.553167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.553923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.554603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:25.554912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.556737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.575938 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 804/1599] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:40:25.579020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.590037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf29f-8b79-4c1e-afd6-18a8e36db6d1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.603811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.604463 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.604744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.605147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.605938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.608363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.652540 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 796/1600] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:25 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:25.660796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.667621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:25.675701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cba4f-4bc2-4f62-98ba-8e3db9b884df admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.820097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.820097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.820097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.822590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.825706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.830301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.870141 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 805/1601] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:25 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:25.870956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.885171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd292-1c20-4224-9672-02e2d6266af4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.895349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.897606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.898075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.898531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.899752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.902122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.917823 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 797/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:25.921438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.935180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae06d8-7b15-4c96-8dc7-e2d985b50478 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.945414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.946059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.946487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.946990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:25.947889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:25.949915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111a0a-a17b-41b4-a2fd-9e2d7d818d11 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:25.965737 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 806/1603] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:25.969681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:25.981636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad48b3-ae94-4653-a2b1-fc4c5bb5d055 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:25.988550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:25.989694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:25.989881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:25.990169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] PATH_INFO: `/v3/projects/53de08e029ed4db69dc274c4cf7857b2/users/889faae4a4b84e469f0cf3762b6f7dc7/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.009609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53de08e029ed4db69dc274c4cf7857b2, user_id=889faae4a4b84e469f0cf3762b6f7dc7, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.012985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.036184 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 798/1604] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:25 2022] PUT /identity/v3/projects/53de08e029ed4db69dc274c4cf7857b2/users/889faae4a4b84e469f0cf3762b6f7dc7/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:26.043617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.043957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.044194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.083584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] MFA Rules not processed for user `889faae4a4b84e469f0cf3762b6f7dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:26.086006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:26.176607 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 807/1605] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:26.181668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.245664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:26.256560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f63c-5f71-44ae-bb9e-b01485d15714 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.262780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.263116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.263304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.263624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.264425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.266352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.296689 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 799/1606] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:26 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:26.301565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.314481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756634-2730-49db-b551-64ccaa9614a0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.387488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.388171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.388565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.388933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.389641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.391730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.414415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:26.428551 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 808/1607] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:26 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:26.432146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.443762 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675451-b534-4b78-85b5-a0c928124b20 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.448611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.449213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.449497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.449905 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.450535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.452226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.463509 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 800/1608] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:26.467905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.480094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38182d6-91e6-4a0b-9dd5-4af891a44cc2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.503526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.504264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.504499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.504772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] PATH_INFO: `/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166/users/259a825a88d04992a25b1b6810a8fdc9/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.534239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=600df7cf6ede4cfb8e5d77017bc3f166, user_id=259a825a88d04992a25b1b6810a8fdc9, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.538120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.560506 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 809/1609] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:26 2022] PUT /identity/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166/users/259a825a88d04992a25b1b6810a8fdc9/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:26.562227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.590519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4199f-bf16-4388-81af-b0071ddee091 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.688285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.689505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.691109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.691642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.692570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.703194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a417d24-ab5c-4857-98ef-ad158c4c6c6d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.719213 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 801/1610] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:26.723466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.741188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9802-464b-49eb-9c8b-fed8f742d7ec admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:26.747888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:26.748762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.749114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.749487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] PATH_INFO: `/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166/users/259a825a88d04992a25b1b6810a8fdc9/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.751948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600df7cf6ede4cfb8e5d77017bc3f166, user_id=259a825a88d04992a25b1b6810a8fdc9, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:26.755023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:26.769689 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 810/1611] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:26 2022] PUT /identity/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166/users/259a825a88d04992a25b1b6810a8fdc9/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:26.782776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:26.784595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:26.784595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:26.838107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] MFA Rules not processed for user `259a825a88d04992a25b1b6810a8fdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:26.839512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:26.958091 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 802/1612] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:26.965083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:26.968930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:27.087354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bf90-2499-4678-baae-71373e646e83 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:27.095377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:27.096421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:27.097535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:27.098004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:27.116707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:27.119013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2b945-b5f8-4416-bb64-52a74225c2ca service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:27.135675 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 811/1613] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:27.319636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:27.375339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:27.391444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4e0c-2066-49f7-9208-c6437cf4941a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:27.396723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:27.397659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:27.398265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:27.398265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] PATH_INFO: `/v3/users/889faae4a4b84e469f0cf3762b6f7dc7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:27.399372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889faae4a4b84e469f0cf3762b6f7dc7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:27.401351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:27.459370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889faae4a4b84e469f0cf3762b6f7dc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:27.460069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889faae4a4b84e469f0cf3762b6f7dc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:27.469734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889faae4a4b84e469f0cf3762b6f7dc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:27.483235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889faae4a4b84e469f0cf3762b6f7dc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:27.483957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889faae4a4b84e469f0cf3762b6f7dc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:27.496921 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 803/1614] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:27 2022] DELETE /identity/v3/users/889faae4a4b84e469f0cf3762b6f7dc7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:27.502583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:27.503046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:27.503150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:27.521863 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:27.523050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:27.581309 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 812/1615] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:27.591207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:27.593037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:27.658504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cdef-90d6-45a2-bd1c-f9f9e3afefc8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:27.666797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:27.668029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:27.668542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:27.668832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:27.680474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:27.681940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b139e7-3f7b-475f-b4c4-90b1a4d631a7 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:27.693578 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 804/1616] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:28.022810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:28.024471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:28.038173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea37a16-4354-41fd-af72-cf9b31610c9c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:28.043105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:28.046085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:28.046085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:28.046085 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] PATH_INFO: `/v3/users/ed8c055ddd754c2e97f4fd306722875b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:28.046669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8c055ddd754c2e97f4fd306722875b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:28.048772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:28.113342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8c055ddd754c2e97f4fd306722875b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.114400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8c055ddd754c2e97f4fd306722875b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.115383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8c055ddd754c2e97f4fd306722875b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.126035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8c055ddd754c2e97f4fd306722875b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.134604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:28.137584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8c055ddd754c2e97f4fd306722875b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.172058 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 813/1617] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:28 2022] DELETE /identity/v3/users/ed8c055ddd754c2e97f4fd306722875b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:28.176652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:28.177207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:28.177710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:28.214069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:28.215542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:28.352672 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 805/1618] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:28.410430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:28.411926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:28.479538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9653f7-4691-4c58-b3e8-6c3eb2652f80 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:28.484784 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:28.485404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:28.485681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:28.485954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:28.497946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:28.500389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:28.517021 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 814/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:28.543023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:28.545320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:28.564461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6eb2-cbf2-4ebd-b29b-8836b2fbc9cf None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:28.571636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:28.572344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:28.572624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:28.572901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] PATH_INFO: `/v3/projects/53de08e029ed4db69dc274c4cf7857b2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:28.574059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53de08e029ed4db69dc274c4cf7857b2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:28.576072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:28.583864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:28.651247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53de08e029ed4db69dc274c4cf7857b2', 'request_id': 'req-1f673895-2b36-4546-8d1e-31f8f98b052f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.659027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53de08e029ed4db69dc274c4cf7857b2', 'request_id': 'req-1f673895-2b36-4546-8d1e-31f8f98b052f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.684364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53de08e029ed4db69dc274c4cf7857b2', 'request_id': 'req-1f673895-2b36-4546-8d1e-31f8f98b052f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.709405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] The token cache is being invalidate because project 53de08e029ed4db69dc274c4cf7857b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:28.709798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.710731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.712906 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 806/1620] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:28 2022] DELETE /identity/v3/projects/53de08e029ed4db69dc274c4cf7857b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:28.717686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:28.734185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0854-0df4-4405-b690-160cf13a903f service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:28.824208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:28.825007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:28.825288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:28.825560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] PATH_INFO: `/v3/users/259a825a88d04992a25b1b6810a8fdc9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:28.827025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259a825a88d04992a25b1b6810a8fdc9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:28.829107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:28.910620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259a825a88d04992a25b1b6810a8fdc9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.913496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259a825a88d04992a25b1b6810a8fdc9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.914614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259a825a88d04992a25b1b6810a8fdc9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.928184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259a825a88d04992a25b1b6810a8fdc9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.950535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259a825a88d04992a25b1b6810a8fdc9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:28.991000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:29.005610 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 815/1621] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:28 2022] DELETE /identity/v3/users/259a825a88d04992a25b1b6810a8fdc9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:29.568577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:29.570093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.586168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f673895-2b36-4546-8d1e-31f8f98b052f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:29.656396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:29.657139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.657492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.657850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] PATH_INFO: `/v3/projects/d3a31de5be1843f181484a36cf584c2f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.658987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a31de5be1843f181484a36cf584c2f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:29.660991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:29.671591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:29.673299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.689659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f125e-be01-4287-a6be-df5bc9e85b62 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:29.697539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:29.698181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.698642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.698942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] PATH_INFO: `/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.700135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600df7cf6ede4cfb8e5d77017bc3f166)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:29.702985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:29.713467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a31de5be1843f181484a36cf584c2f', 'request_id': 'req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.720162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a31de5be1843f181484a36cf584c2f', 'request_id': 'req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.727415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a31de5be1843f181484a36cf584c2f', 'request_id': 'req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.742146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] The token cache is being invalidate because project d3a31de5be1843f181484a36cf584c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:29.742729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.743385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.744938 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 807/1622] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:29 2022] DELETE /identity/v3/projects/d3a31de5be1843f181484a36cf584c2f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:29.748915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:29.750220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.759488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600df7cf6ede4cfb8e5d77017bc3f166', 'request_id': 'req-3f414d97-aa52-400b-95d2-a9cb47c258f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.766450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600df7cf6ede4cfb8e5d77017bc3f166', 'request_id': 'req-3f414d97-aa52-400b-95d2-a9cb47c258f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.774434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600df7cf6ede4cfb8e5d77017bc3f166', 'request_id': 'req-3f414d97-aa52-400b-95d2-a9cb47c258f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.777750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:29.788354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] The token cache is being invalidate because project 600df7cf6ede4cfb8e5d77017bc3f166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:29.788646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.789271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3f414d97-aa52-400b-95d2-a9cb47c258f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.790992 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 816/1623] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:29 2022] DELETE /identity/v3/projects/600df7cf6ede4cfb8e5d77017bc3f166 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:29.795841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8e9b3-de7b-4197-af82-7b3fe1059223 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.796148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8e9b3-de7b-4197-af82-7b3fe1059223 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.796510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8e9b3-de7b-4197-af82-7b3fe1059223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.817289 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-19c8e9b3-de7b-4197-af82-7b3fe1059223 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:29.818501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-19c8e9b3-de7b-4197-af82-7b3fe1059223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.822116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d7f33-d1bf-41e3-b309-6374e7fb7886 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:29.887324 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 817/1624] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:29.890392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:29.891034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.891313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.891585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] PATH_INFO: `/v3/users/b5a87c60874046f097ae8de76c422171` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.892834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a87c60874046f097ae8de76c422171)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:29.894793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:29.897263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.897551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.897824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.921557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:29.922897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.931805 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 818/1625] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:29.936354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:29.942850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a87c60874046f097ae8de76c422171'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.944264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a87c60874046f097ae8de76c422171'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.947845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb09ae-22a6-4d9d-a537-2fa017ed9d12 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:29.957432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:29.958064 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:29.958392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:29.958667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:29.959716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a87c60874046f097ae8de76c422171'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.960993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:29.962074 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:29.963693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:29.976175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a87c60874046f097ae8de76c422171'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.976901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a87c60874046f097ae8de76c422171'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:29.978336 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 819/1626] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:40:29.982645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:29.984332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:29.994230 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 808/1627] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:29 2022] DELETE /identity/v3/users/b5a87c60874046f097ae8de76c422171 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:29.999423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d390a-4eb6-4313-8b8f-1aa2bec021f7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.059475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.060216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.060570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.060836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.061578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.063483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.073986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:30.097883 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 820/1628] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:29 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:30.099348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.110990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f0c-7c06-4080-9b85-1da1c001549f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.195767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:30.212204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.212941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.213226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.213512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.214423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.218053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.245684 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 809/1629] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:30 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:30.250362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.261513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136b3f-428a-4560-a761-750ba5311bbf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.267679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.268491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.268829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.269160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.270424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.272003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.286884 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 821/1630] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:30.288105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.299791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e937c-81c7-4608-9ba1-5fd831c61cac admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.304974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.305625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.305792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.306305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.306959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.308837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0158e8-0edb-4f3d-ad95-a65b1efbeeb8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.325979 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 810/1631] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:30.332100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.348407 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986284-694d-4ec4-bb98-0db6d503eca6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.349474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.350198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.350596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.350933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] PATH_INFO: `/v3/projects/ec0274a9f1b74c86ac10e2aa533da121/users/e52e4719bcd54558a48bbd8db8b77071/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.369887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0274a9f1b74c86ac10e2aa533da121, user_id=e52e4719bcd54558a48bbd8db8b77071, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.373568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.389811 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 822/1632] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:30 2022] PUT /identity/v3/projects/ec0274a9f1b74c86ac10e2aa533da121/users/e52e4719bcd54558a48bbd8db8b77071/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:30.400699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.401080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.401448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.430417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] MFA Rules not processed for user `e52e4719bcd54558a48bbd8db8b77071`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:30.431722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:30.505339 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 811/1633] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:30.522097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.526463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:30.542093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.544002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:30.626492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62b5bf-c573-4e71-94e3-4e9c024b90eb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.630389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.631050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.631931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.632348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.643158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.644968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.674477 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 823/1634] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:30.675359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bafca-4ac2-46a6-b9e3-be2583ee4df3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.680110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.680740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.681013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.681428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] PATH_INFO: `/v3/projects/1fc966efc11a41fcb268dac2450241cb` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.682564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc966efc11a41fcb268dac2450241cb)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.684824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.710615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.731150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517179-7cca-4f2d-aa12-57197b8ed4e4 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.746256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.746918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.747189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.747572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] PATH_INFO: `/v3/users/e52e4719bcd54558a48bbd8db8b77071` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.749437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52e4719bcd54558a48bbd8db8b77071)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.751644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.760002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc966efc11a41fcb268dac2450241cb', 'request_id': 'req-25f866ac-d867-460b-99b1-42d03f89eb00'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.767890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc966efc11a41fcb268dac2450241cb', 'request_id': 'req-25f866ac-d867-460b-99b1-42d03f89eb00'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.770702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:30.777420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc966efc11a41fcb268dac2450241cb', 'request_id': 'req-25f866ac-d867-460b-99b1-42d03f89eb00'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.814421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] The token cache is being invalidate because project 1fc966efc11a41fcb268dac2450241cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:30.814842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.815813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.819964 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 812/1635] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:30 2022] DELETE /identity/v3/projects/1fc966efc11a41fcb268dac2450241cb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:30.821942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.824027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:30.840325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52e4719bcd54558a48bbd8db8b77071'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.841034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52e4719bcd54558a48bbd8db8b77071'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.842301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52e4719bcd54558a48bbd8db8b77071'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.850537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52e4719bcd54558a48bbd8db8b77071'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.863698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5c03480b-7bf8-45b8-9a7e-f07467d5d2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52e4719bcd54558a48bbd8db8b77071'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:30.887956 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 824/1636] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:30 2022] DELETE /identity/v3/users/e52e4719bcd54558a48bbd8db8b77071 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:30.891758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.892086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.892364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.902323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f866ac-d867-460b-99b1-42d03f89eb00 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:30.916497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:30.917875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:30.947009 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:30.974973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:30.975611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:30.975918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:30.976202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] PATH_INFO: `/v3/users/392a599433674a19ada22a6561d7b9ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:30.977342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392a599433674a19ada22a6561d7b9ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:30.979265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:30.985431 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 825/1637] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:30.995030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:30.996454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.029775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392a599433674a19ada22a6561d7b9ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.030477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392a599433674a19ada22a6561d7b9ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.037879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392a599433674a19ada22a6561d7b9ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.051077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392a599433674a19ada22a6561d7b9ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.051748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392a599433674a19ada22a6561d7b9ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.057124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675708e4-90e1-46bb-98b0-17373ed316a1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.061301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.061989 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.062268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.062539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.064310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.064806 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 813/1638] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:30 2022] DELETE /identity/v3/users/392a599433674a19ada22a6561d7b9ed => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:31.076440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.077875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.087717 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 826/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:31.428116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.430820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.483542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:31.503928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.506826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.523906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0c07-7a8a-4371-8c44-6ca34f5cf086 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.556590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b629-c8aa-4807-8361-cb4ba615d1d4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.562965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.563603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.563899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.564480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] PATH_INFO: `/v3/projects/ec0274a9f1b74c86ac10e2aa533da121` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.565632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0274a9f1b74c86ac10e2aa533da121)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.568160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.640320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.640999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.641278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.641392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0274a9f1b74c86ac10e2aa533da121', 'request_id': 'req-af544d71-bcee-4180-85d2-ba280c2a427a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.641545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] PATH_INFO: `/v3/projects/d475225bf5ed404cb20b95e525ec4316` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.642711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d475225bf5ed404cb20b95e525ec4316)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.644711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.657755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0274a9f1b74c86ac10e2aa533da121', 'request_id': 'req-af544d71-bcee-4180-85d2-ba280c2a427a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.666085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0274a9f1b74c86ac10e2aa533da121', 'request_id': 'req-af544d71-bcee-4180-85d2-ba280c2a427a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.683753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] The token cache is being invalidate because project ec0274a9f1b74c86ac10e2aa533da121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:31.684328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.684753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-af544d71-bcee-4180-85d2-ba280c2a427a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.700043 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 814/1640] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:31 2022] DELETE /identity/v3/projects/ec0274a9f1b74c86ac10e2aa533da121 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:31.700043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3b38-b804-41e7-91f1-4ae139714680 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.700043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3b38-b804-41e7-91f1-4ae139714680 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.700043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3b38-b804-41e7-91f1-4ae139714680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.702305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd475225bf5ed404cb20b95e525ec4316', 'request_id': 'req-6e3852a4-aed4-44fd-86b6-87676cfdad92'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.708953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd475225bf5ed404cb20b95e525ec4316', 'request_id': 'req-6e3852a4-aed4-44fd-86b6-87676cfdad92'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.715387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd475225bf5ed404cb20b95e525ec4316', 'request_id': 'req-6e3852a4-aed4-44fd-86b6-87676cfdad92'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.718070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-563e3b38-b804-41e7-91f1-4ae139714680 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:31.719299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-563e3b38-b804-41e7-91f1-4ae139714680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.735717 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] The token cache is being invalidate because project d475225bf5ed404cb20b95e525ec4316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:31.736045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.740316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e3852a4-aed4-44fd-86b6-87676cfdad92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:31.747466 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 827/1641] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:31 2022] DELETE /identity/v3/projects/d475225bf5ed404cb20b95e525ec4316 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:31.749022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecf9de-a134-4b8e-9a39-ce4d0c6c8992 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.749343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecf9de-a134-4b8e-9a39-ce4d0c6c8992 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.749582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecf9de-a134-4b8e-9a39-ce4d0c6c8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.766047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:31.782489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-70ecf9de-a134-4b8e-9a39-ce4d0c6c8992 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:31.784072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-70ecf9de-a134-4b8e-9a39-ce4d0c6c8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.802379 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 815/1642] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:31.811251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145cab-e3e3-4657-b317-22568b479211 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.811595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145cab-e3e3-4657-b317-22568b479211 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.811923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145cab-e3e3-4657-b317-22568b479211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.849502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-39145cab-e3e3-4657-b317-22568b479211 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:31.851217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-39145cab-e3e3-4657-b317-22568b479211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.862831 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 816/1643] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:31.867438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39145cab-e3e3-4657-b317-22568b479211 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.884122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39145cab-e3e3-4657-b317-22568b479211 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.890048 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 828/1644] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:31.890953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.891571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.891845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.892147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.893392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:31.893392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.894845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.897676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.898208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.899292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.912093 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 817/1645] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:40:31.918874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.929524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:31.930805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:31.933881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9ddd2-548b-40dc-b1d4-2713bc8a4f23 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.939730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.940362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.940672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.940941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.941435 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 829/1646] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:31.941579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.943468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.945467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.958066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c3d9-33c3-4ec6-8056-d4a2a23b0599 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:31.963538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:31.964237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:31.964506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:31.964775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:31.966967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:31.967361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:31.969001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:31.980232 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 818/1647] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:31.986458 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 830/1648] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:40:31.986604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.987732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:31.993883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.000279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027e49-f84a-46ff-96f1-bb88be9c0cb6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.058521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a125ef-e93c-4e24-9d41-70945fcb69ff admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.063996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.064608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.064884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.065154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.065806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.066121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.066749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.067024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.067311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.067978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.068529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.069864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.096441 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 819/1649] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:32.097570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.100493 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 831/1650] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:31 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:32.105791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.108331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-8a16-4731-baf8-b1bf55bb0538 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.163980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.164601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.164884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.165155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.165798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.167415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.168317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899cb4-8623-49c0-818a-1ba2193d8164 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.173967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.174614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.174890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.175169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.175790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.177728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.178677 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 820/1651] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:32.182379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.193190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc676b94-1855-444f-ba40-6e103032ec32 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.195793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.198533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.199118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.199386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.199712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.200326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.202118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.203583 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 832/1652] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:32 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:32.207372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.220454 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 821/1653] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:32.220667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b7c3-ae53-4964-ab10-ffc5ff1524f4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.221569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.224115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.224713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.224988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.225253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.225883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.228136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.231370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222a89c-f4a1-4090-be3c-a790afac0434 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.236592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.237232 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.237518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.237787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] PATH_INFO: `/v3/projects/aab0bf27d6c7415f9d3fc8f873a0607f/users/0f8ed34d4b774af4821303c98872e6e7/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.241929 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 833/1654] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:32.242889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.253170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab0bf27d6c7415f9d3fc8f873a0607f, user_id=0f8ed34d4b774af4821303c98872e6e7, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.253338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227001d7-2455-423c-90e6-516f0873bb40 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.255829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0954-fb08-476f-a4ce-071003c5ec0b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.257903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.258468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.258746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.259012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.259628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.261224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.268482 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 822/1655] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:32 2022] PUT /identity/v3/projects/aab0bf27d6c7415f9d3fc8f873a0607f/users/0f8ed34d4b774af4821303c98872e6e7/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:40:32.277743 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 834/1656] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:32.280415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.280605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.280892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.281166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.290107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4078b53-7b99-4857-aa81-ca15655de381 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.308995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] MFA Rules not processed for user `0f8ed34d4b774af4821303c98872e6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:32.310259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:32.350374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.351024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.351304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.351626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] PATH_INFO: `/v3/projects/5bdf324690994fbdbe004664f1bccc3e/users/dd7e6ea5a97c4733addd440e285ea484/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.355640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.367401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdf324690994fbdbe004664f1bccc3e, user_id=dd7e6ea5a97c4733addd440e285ea484, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.370526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35439a-a603-4145-8859-f1c0f456acd1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.379320 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 823/1657] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:32.386846 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 835/1658] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:32 2022] PUT /identity/v3/projects/5bdf324690994fbdbe004664f1bccc3e/users/dd7e6ea5a97c4733addd440e285ea484/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:32.390498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.392056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:32.398024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.398312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.398586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.429618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] MFA Rules not processed for user `dd7e6ea5a97c4733addd440e285ea484`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:32.430845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:32.455561 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b4e4-fc6b-48e2-86ff-32916f10a171 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.522963 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 836/1659] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:32.527502 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.531004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.531814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.532218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.532584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.594901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.615684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29070-38bb-4652-b82c-9faa2a8e7bca None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.621031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.623643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.624224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.625379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.626353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.629510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.631975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.634135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.660247 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 824/1660] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:40:32.702525 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 837/1661] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:32 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:32.712758 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.744190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6757-f78d-4a91-9bbc-6a72a49a43cc service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.832125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.860213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.861147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.861435 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.861709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.862518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.864663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.902722 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 825/1662] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:32 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:32.904373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.918745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac45a2-13e1-47b8-9831-b781df483e45 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.931951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b68be-9602-4535-831e-343903f416bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.932712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b68be-9602-4535-831e-343903f416bc admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:32.932994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b68be-9602-4535-831e-343903f416bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:32.933270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b68be-9602-4535-831e-343903f416bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:32.933923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b68be-9602-4535-831e-343903f416bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:32.936966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b68be-9602-4535-831e-343903f416bc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:32.960189 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 838/1663] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:32.964072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:32.987429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd6c70-179e-4de0-92ee-a52abba0f622 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:32.998156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:32.999511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.001416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.002022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.003939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.006026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb97451-4d35-4085-89ab-2b72d84e889d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.023486 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 826/1664] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:33.027946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b68be-9602-4535-831e-343903f416bc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.045671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b68be-9602-4535-831e-343903f416bc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.050550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.051294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.051685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.052072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] PATH_INFO: `/v3/projects/de6919761e944ab0937c6f13a724eac1/users/d58dffd737af4150acd993dc6ce7dbb2/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.117067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6919761e944ab0937c6f13a724eac1, user_id=d58dffd737af4150acd993dc6ce7dbb2, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.119844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.148156 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 839/1665] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:33 2022] PUT /identity/v3/projects/de6919761e944ab0937c6f13a724eac1/users/d58dffd737af4150acd993dc6ce7dbb2/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:33.158789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.159090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.159351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.226211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] MFA Rules not processed for user `d58dffd737af4150acd993dc6ce7dbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:33.227770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:33.354236 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 827/1666] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:33.358954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.438112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29222-1dfc-43bd-8dfb-98e88e5f369d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.442582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.443282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.443563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.443829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.444495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.446379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.475307 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 840/1667] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:33.479415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.490632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61025e8d-99f4-47ab-8689-f68fe7027c44 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.551821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.552599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.552884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.553156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.556213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.558464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.589983 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 828/1668] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:33 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:40:33.595558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.620235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5f37-86e8-4187-8bf5-7f6df5d60f2a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.625665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.626353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.626709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.627050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.628229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.630210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.648881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.659467 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 841/1669] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:33.662820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a494-93b3-4ca2-ac27-8c696007e238 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.667676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.668942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.669257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.670062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] PATH_INFO: `/v3/projects/8481446c27554ad38135e6e0d161e99a/users/0a41087024674d6aaf6df41497af5bec/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.690263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8481446c27554ad38135e6e0d161e99a, user_id=0a41087024674d6aaf6df41497af5bec, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.694833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.714522 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 829/1670] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:33 2022] PUT /identity/v3/projects/8481446c27554ad38135e6e0d161e99a/users/0a41087024674d6aaf6df41497af5bec/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:33.720311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.737694 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca849d-0f41-4ea6-9f53-be58b9d9933e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.845948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.861856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.863298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.863523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.864919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.869322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25406b-f1ae-4d8c-9f5e-cbc4dd10a1b2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.889607 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 842/1671] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:33.893773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:33.909171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13560-14d5-4f14-96c5-4eaad6bd0b25 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:33.914867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:33.915542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.915825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.916146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] PATH_INFO: `/v3/projects/8481446c27554ad38135e6e0d161e99a/users/0a41087024674d6aaf6df41497af5bec/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.918749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8481446c27554ad38135e6e0d161e99a, user_id=0a41087024674d6aaf6df41497af5bec, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:33.921860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:33.936468 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 830/1672] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:33 2022] PUT /identity/v3/projects/8481446c27554ad38135e6e0d161e99a/users/0a41087024674d6aaf6df41497af5bec/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:33.948044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815471e-7a54-4773-9b6a-1f4b9d2fea03 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:33.948264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815471e-7a54-4773-9b6a-1f4b9d2fea03 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:33.948533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815471e-7a54-4773-9b6a-1f4b9d2fea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:33.986984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:34.003302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9815471e-7a54-4773-9b6a-1f4b9d2fea03 None None] MFA Rules not processed for user `0a41087024674d6aaf6df41497af5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:34.004645 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9815471e-7a54-4773-9b6a-1f4b9d2fea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:34.075325 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 843/1673] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:34.087395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:34.105360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:34.144600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee6fa-78b7-4ff9-af9c-907452c7e6ad admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:34.148311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:34.148915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:34.149196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:34.149467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:34.255454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:34.257172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:34.264494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:34.264494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:34.265123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:34.277957 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 831/1674] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:34.289975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] MFA Rules not processed for user `0f8ed34d4b774af4821303c98872e6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:34.292735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:34.402505 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 844/1675] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:36.190113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:36.200788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656ed4-c0bd-4a9b-8b17-0760f8a59c2c service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:36.206299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:36.207298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:36.207682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:36.208789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:36.313847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:36.316367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:36.340482 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 832/1676] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:37.134888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:37.145399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a0542-eb56-450e-9bf0-87b0bd29af56 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:37.149066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:37.149687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:37.149950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:37.150217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:37.160353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:37.161792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e841-6c8c-4e4a-8175-1143560b5f92 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:37.173956 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 845/1677] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:41.304031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:41.387962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22106-e93f-4346-8b45-55cc9ec50f42 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:41.394054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:41.394695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:41.395781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:41.396115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] PATH_INFO: `/v3/users/dd7e6ea5a97c4733addd440e285ea484` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:41.397283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7e6ea5a97c4733addd440e285ea484)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:41.400146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:41.413662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:41.464014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7e6ea5a97c4733addd440e285ea484'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:41.464812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7e6ea5a97c4733addd440e285ea484'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:41.474150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7e6ea5a97c4733addd440e285ea484'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:41.498226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7e6ea5a97c4733addd440e285ea484'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:41.499159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7e6ea5a97c4733addd440e285ea484'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:41.512652 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 833/1678] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:41 2022] DELETE /identity/v3/users/dd7e6ea5a97c4733addd440e285ea484 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:41.518291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:41.518780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:41.518952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:41.541767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:41.543230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:41.618708 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 846/1679] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:41.630254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:41.631793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:41.697441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7d0-57b0-4f25-9fa6-0e919012b4ca admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:41.702697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:41.703416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:41.703767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:41.704140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:41.714849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:41.717048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:41.728447 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 834/1680] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:42.057606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:42.059108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:42.072944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fccc4-d444-40e1-9d5d-f9de3dcfc6d9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:42.078744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:42.080944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:42.081102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:42.081347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] PATH_INFO: `/v3/projects/5bdf324690994fbdbe004664f1bccc3e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:42.082507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdf324690994fbdbe004664f1bccc3e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:42.084524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:42.128028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:42.161446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdf324690994fbdbe004664f1bccc3e', 'request_id': 'req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.167462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdf324690994fbdbe004664f1bccc3e', 'request_id': 'req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.174786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdf324690994fbdbe004664f1bccc3e', 'request_id': 'req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.188066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] The token cache is being invalidate because project 5bdf324690994fbdbe004664f1bccc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:42.188355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.188980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.190678 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 847/1681] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:42 2022] DELETE /identity/v3/projects/5bdf324690994fbdbe004664f1bccc3e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:42.194394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:42.204110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27e5-46ab-44a7-b4dc-19fce2f51154 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:42.259738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:42.260385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:42.260663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:42.260936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] PATH_INFO: `/v3/users/d58dffd737af4150acd993dc6ce7dbb2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:42.262048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58dffd737af4150acd993dc6ce7dbb2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:42.264102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:42.298818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:42.311690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58dffd737af4150acd993dc6ce7dbb2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.312363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58dffd737af4150acd993dc6ce7dbb2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.319419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58dffd737af4150acd993dc6ce7dbb2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.332286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58dffd737af4150acd993dc6ce7dbb2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.332948 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58dffd737af4150acd993dc6ce7dbb2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.345508 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 835/1682] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:42 2022] DELETE /identity/v3/users/d58dffd737af4150acd993dc6ce7dbb2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:42.733619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:42.735779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:42.753730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6883-ecdf-4b81-b10e-a3b1d0a4e992 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:42.829428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:42.829970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:42.830245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:42.830511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] PATH_INFO: `/v3/projects/de6919761e944ab0937c6f13a724eac1` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:42.831664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6919761e944ab0937c6f13a724eac1)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:42.833660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:42.882881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6919761e944ab0937c6f13a724eac1', 'request_id': 'req-54f4c21d-52e6-46dd-9558-21fd0ce678b9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.889097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6919761e944ab0937c6f13a724eac1', 'request_id': 'req-54f4c21d-52e6-46dd-9558-21fd0ce678b9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.895500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6919761e944ab0937c6f13a724eac1', 'request_id': 'req-54f4c21d-52e6-46dd-9558-21fd0ce678b9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.909003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] The token cache is being invalidate because project de6919761e944ab0937c6f13a724eac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:42.909318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.909929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:42.911425 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 848/1683] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:42 2022] DELETE /identity/v3/projects/de6919761e944ab0937c6f13a724eac1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:42.915482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:42.916955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:42.931102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acb412-f8cd-4e0e-a3be-0609470c1ffb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:42.987572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:42.988230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:42.988507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:42.988780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] PATH_INFO: `/v3/users/0a41087024674d6aaf6df41497af5bec` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:42.989880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a41087024674d6aaf6df41497af5bec)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:42.991796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:43.049885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a41087024674d6aaf6df41497af5bec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.050981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a41087024674d6aaf6df41497af5bec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.061992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a41087024674d6aaf6df41497af5bec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.076954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a41087024674d6aaf6df41497af5bec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.077658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eb08313f-42ae-4792-aef5-a63763fbca6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a41087024674d6aaf6df41497af5bec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.094091 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 836/1684] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:42 2022] DELETE /identity/v3/users/0a41087024674d6aaf6df41497af5bec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:43.660489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:43.662381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:43.677922 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4c21d-52e6-46dd-9558-21fd0ce678b9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:43.717026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:43.741932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:43.742567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:43.742969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:43.743247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] PATH_INFO: `/v3/projects/8481446c27554ad38135e6e0d161e99a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:43.744543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8481446c27554ad38135e6e0d161e99a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:43.746459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:43.795814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8481446c27554ad38135e6e0d161e99a', 'request_id': 'req-23c7400c-13ea-4661-a173-446f45dda665'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.802043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8481446c27554ad38135e6e0d161e99a', 'request_id': 'req-23c7400c-13ea-4661-a173-446f45dda665'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.809963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8481446c27554ad38135e6e0d161e99a', 'request_id': 'req-23c7400c-13ea-4661-a173-446f45dda665'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.825394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] The token cache is being invalidate because project 8481446c27554ad38135e6e0d161e99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:43.825856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.827191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23c7400c-13ea-4661-a173-446f45dda665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:43.828811 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 849/1685] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:43 2022] DELETE /identity/v3/projects/8481446c27554ad38135e6e0d161e99a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:43.833643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:43.834127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:43.834526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:43.994034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:43.995200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:44.022244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:44.061606 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 837/1686] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:44.069827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.070113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.070386 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.094764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:44.096031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:44.108026 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 850/1687] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:44.109840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.121084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b23e-7da7-4199-a4fc-5d5cc56c2804 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.126963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.127844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.128248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.128530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.129184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:40:44.129631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.131261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.144254 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 838/1688] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:40:44.148833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.158324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556b44-70e1-4212-b4cc-194813c25a2f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.162945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.163539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.163814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.164212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.164839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.166796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.209131 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 851/1689] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:40:44 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:44.213633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.230831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477868-5533-4914-8e6e-3bdc39c0411a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.305740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.306356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.306638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.306911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.307552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.309534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.334867 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 839/1690] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:40:44 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:40:44.339541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.351481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc817-b6be-4845-aad4-0640e84485d1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.356623 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.357860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.358268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.358549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.359243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.361167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.384384 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 852/1691] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:40:44.388680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.398985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02eea-9008-44fe-ab6c-24533bc88f40 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.403543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.404849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.405128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.405397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.406031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.407677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e0e-5a8a-4baa-b141-0d4257b98bf6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.417520 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 840/1692] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:40:44.422585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.433239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e3b5-cd09-4b1f-be6e-664de2adf349 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.438294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.438941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.439219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.439490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] PATH_INFO: `/v3/projects/0589506e933c4ba894db2431674942d1/users/4bf84d0adda940aa8330533a9be8141d/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.454509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0589506e933c4ba894db2431674942d1, user_id=4bf84d0adda940aa8330533a9be8141d, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.457480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.471313 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 853/1693] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:40:44 2022] PUT /identity/v3/projects/0589506e933c4ba894db2431674942d1/users/4bf84d0adda940aa8330533a9be8141d/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:44.481601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49844365-3700-4de2-8457-75e19c324650 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.481968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49844365-3700-4de2-8457-75e19c324650 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.482776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49844365-3700-4de2-8457-75e19c324650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.512551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-49844365-3700-4de2-8457-75e19c324650 None None] MFA Rules not processed for user `4bf84d0adda940aa8330533a9be8141d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:44.514163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-49844365-3700-4de2-8457-75e19c324650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:44.577329 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 841/1694] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:40:44.588125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:44.589917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:44.650915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21617e84-617d-4537-a249-4a60988e835c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:44.656331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:44.656937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:44.657232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:44.657503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:44.666680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:44.668147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11049065-80fd-4a0f-adf6-62863e1f209e service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:44.677358 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 854/1695] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:54.574764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:54.673279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:55.039287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49844365-3700-4de2-8457-75e19c324650 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:55.105032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49844365-3700-4de2-8457-75e19c324650 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:55.110531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:55.111170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:55.111455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:55.111725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] PATH_INFO: `/v3/users/4bf84d0adda940aa8330533a9be8141d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:55.112961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf84d0adda940aa8330533a9be8141d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:55.114890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:55.166921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf84d0adda940aa8330533a9be8141d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.167606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf84d0adda940aa8330533a9be8141d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.176078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf84d0adda940aa8330533a9be8141d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.188637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf84d0adda940aa8330533a9be8141d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.189324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf84d0adda940aa8330533a9be8141d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.201733 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 842/1696] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:40:55 2022] DELETE /identity/v3/users/4bf84d0adda940aa8330533a9be8141d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:40:55.206244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:55.206598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:55.206941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:55.227421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:40:55.228726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:55.297668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 855/1697] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:40:55.307280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:55.308751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:55.374089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f7704-2f8b-4a24-8924-51cbbfa21dcb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:55.377734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:55.378334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:55.378609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:55.378876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:55.388661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:55.390949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:55.402068 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 843/1698] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:40:55.874514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:40:55.877219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:40:55.893468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8ae6-61f4-4437-87bd-3518038d742d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:40:55.900360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:40:55.901454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:40:55.901785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:40:55.902236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] PATH_INFO: `/v3/projects/0589506e933c4ba894db2431674942d1` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:40:55.905509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0589506e933c4ba894db2431674942d1)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:40:55.907792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:40:55.955314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0589506e933c4ba894db2431674942d1', 'request_id': 'req-070d83fd-f825-45e8-bafb-e15df6fecb60'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.961135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0589506e933c4ba894db2431674942d1', 'request_id': 'req-070d83fd-f825-45e8-bafb-e15df6fecb60'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.968255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0589506e933c4ba894db2431674942d1', 'request_id': 'req-070d83fd-f825-45e8-bafb-e15df6fecb60'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.985439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] The token cache is being invalidate because project 0589506e933c4ba894db2431674942d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:40:55.985732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.986357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-070d83fd-f825-45e8-bafb-e15df6fecb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:40:55.988083 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 856/1699] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:40:55 2022] DELETE /identity/v3/projects/0589506e933c4ba894db2431674942d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:00.131122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:00.132530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:00.159669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:00.190881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd14d4-9874-4592-aee8-944793d3aecf service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:00.238106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:00.238705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:00.238983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:00.239251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:00.241007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:00.302189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:00.303612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0155f-a876-4ccc-a3d0-5b96d61d13e6 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:00.313556 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 844/1700] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:05.980571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:08.604381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.604995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.604995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.606803 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 857/1701] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:41:08.640399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bbbd-31b7-4312-9ae5-d71a4797185c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.641222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bbbd-31b7-4312-9ae5-d71a4797185c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.641647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bbbd-31b7-4312-9ae5-d71a4797185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.693539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:08.695523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:08.707986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5844bbbd-31b7-4312-9ae5-d71a4797185c None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:08.709402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5844bbbd-31b7-4312-9ae5-d71a4797185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:08.792304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804414d-d0ab-4a4e-bd85-be9e779ef7bd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:08.797577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:08.798205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.798482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.798779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] PATH_INFO: `/v3/users/dda9dd9eb8d3446c96b0c702dd09d2fa` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.799955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda9dd9eb8d3446c96b0c702dd09d2fa)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:08.801391 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 845/1702] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:08.801994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:08.813684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd22cd-d39f-4671-ac7d-4ce0e17e16c0 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.813968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd22cd-d39f-4671-ac7d-4ce0e17e16c0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.814246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd22cd-d39f-4671-ac7d-4ce0e17e16c0 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.815636 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 846/1703] 10.222.0.33 () {54 vars in 961 bytes} [Wed Oct 19 00:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:41:08.821704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.821986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.822256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.844727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:08.845932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:08.853257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda9dd9eb8d3446c96b0c702dd09d2fa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:08.853902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda9dd9eb8d3446c96b0c702dd09d2fa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:08.854508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda9dd9eb8d3446c96b0c702dd09d2fa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:08.855079 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 847/1704] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Oct 19 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:08.862544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda9dd9eb8d3446c96b0c702dd09d2fa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:08.864184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:08.870949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda9dd9eb8d3446c96b0c702dd09d2fa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:08.874351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890e5c-c3a6-437f-be6c-3fdd9f1ee1cd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:08.879575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:08.880250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:08.880539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:08.880820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:08.882580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:08.890136 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 858/1705] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:08 2022] DELETE /identity/v3/users/dda9dd9eb8d3446c96b0c702dd09d2fa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:08.894173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:08.895773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487c7df-9ff3-49a6-8eab-4ba51c5d4cb1 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:08.906768 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 848/1706] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:41:09.094788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.096345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:09.183879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b7d2-d3f2-480c-a64f-7a9017477121 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.188966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.189897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.190327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.190746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] PATH_INFO: `/v3/projects/dfb46376a666496b896ad085315c58fd` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.192266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb46376a666496b896ad085315c58fd)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.194937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.221361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:09.249056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb46376a666496b896ad085315c58fd', 'request_id': 'req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:09.255452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb46376a666496b896ad085315c58fd', 'request_id': 'req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:09.261798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb46376a666496b896ad085315c58fd', 'request_id': 'req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:09.274794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] The token cache is being invalidate because project dfb46376a666496b896ad085315c58fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:09.275081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:09.275690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-56294dbd-db39-4fb9-a605-b7dbfa2f2c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:09.277226 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 859/1707] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:09 2022] DELETE /identity/v3/projects/dfb46376a666496b896ad085315c58fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:09.283095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.283403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.283699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.292040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:09.303747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:09.304971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:09.363977 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 849/1708] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:09.371791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.372103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.372377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.393272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:09.394576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:09.402607 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 860/1709] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:09.407064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.416525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4094cf6-47f0-47e3-9c5b-a7caa7fb7185 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.420974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.421549 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.421822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.422090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.422717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:09.423011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.424624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.435770 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 850/1710] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:09.441372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.450841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbed7d-cd0b-44c9-8f71-0142554d3de1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.456447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.457030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.457301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.457567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.458193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.460741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.488669 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 861/1711] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:09 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:09.492812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.503526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debf93-8594-4683-9f7a-d5137e71ea98 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.558191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.558784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.559065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.559341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.560029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.562552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.583914 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 851/1712] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:09 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:09.588000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.598465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901b2b-7049-4e53-a01b-461c0a0b61bc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.603017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.603594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.603897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.604165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.604820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.606402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.617460 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 862/1713] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:09.621346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.632536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5e8-e592-41a2-a916-e8fce754dc08 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.637006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.637587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.637862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.638131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.638763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.641537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e50a-efaf-4e47-987c-9f660242ad2e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.652229 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 852/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:09.656409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.666346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09111a-c7fd-4d3c-b852-dfd8f52f5647 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.671350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.672039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.672355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.672625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] PATH_INFO: `/v3/projects/4cb68a88f174402d8ad45065830a7d16/users/60e5ac0e700d47a2a75eeaccc35b655c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.688164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb68a88f174402d8ad45065830a7d16, user_id=60e5ac0e700d47a2a75eeaccc35b655c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.690844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.705322 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 863/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:09 2022] PUT /identity/v3/projects/4cb68a88f174402d8ad45065830a7d16/users/60e5ac0e700d47a2a75eeaccc35b655c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:09.715226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865a99-b72a-4197-83d6-df3d4a82822c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.715516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865a99-b72a-4197-83d6-df3d4a82822c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.715793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865a99-b72a-4197-83d6-df3d4a82822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.744270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-12865a99-b72a-4197-83d6-df3d4a82822c None None] MFA Rules not processed for user `60e5ac0e700d47a2a75eeaccc35b655c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:09.745521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-12865a99-b72a-4197-83d6-df3d4a82822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:09.810626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:09.814946 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 853/1716] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:09.825754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:09.828652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:09.905613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81273ae-70c9-48b8-b86c-3fc6d48f8f84 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:09.911248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:09.911898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:09.912206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:09.912478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:09.920583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:09.922354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:09.932023 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 864/1717] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:11.602660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778837-ad1c-4dbf-be84-f81518944c53 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:11.603367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778837-ad1c-4dbf-be84-f81518944c53 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:11.603678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778837-ad1c-4dbf-be84-f81518944c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:11.625477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-03778837-ad1c-4dbf-be84-f81518944c53 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:11.626901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-03778837-ad1c-4dbf-be84-f81518944c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:11.695225 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 854/1718] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:41:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:11.751003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:11.753073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:11.795690 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:11.846574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e343c-9745-4ea0-9eeb-c34d42e13833 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:11.853450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:11.854061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:11.854344 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:11.854615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:11.865086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:11.866713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:11.882213 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 865/1719] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:12.429303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483133f-038a-48e1-9d59-a5af8adfe63a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:12.429664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483133f-038a-48e1-9d59-a5af8adfe63a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:12.430009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483133f-038a-48e1-9d59-a5af8adfe63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:12.450513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4483133f-038a-48e1-9d59-a5af8adfe63a None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:12.451791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4483133f-038a-48e1-9d59-a5af8adfe63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:12.459278 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 855/1720] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:12.472642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:12.484770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c0d89-ccac-4f51-9d41-7448898837c5 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:12.490156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:12.490686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:12.490963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:12.491232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:12.500190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:12.501650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:12.510058 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 866/1721] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:12.805314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6db0-2597-44d6-ac17-985f6e713b51 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:12.805783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6db0-2597-44d6-ac17-985f6e713b51 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:12.805911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6db0-2597-44d6-ac17-985f6e713b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:12.826676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fcbf6db0-2597-44d6-ac17-985f6e713b51 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:12.828439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fcbf6db0-2597-44d6-ac17-985f6e713b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:12.835333 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 856/1722] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:12.847798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:12.858734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1f8d-a541-420d-8eb6-c4dcb19f5cb7 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:12.864428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:12.865047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:12.865324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:12.865594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:12.874724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:12.876476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:12.886781 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 867/1723] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:13.278441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:13.278726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:13.279019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:13.298133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:13.299309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:13.306217 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 857/1724] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:13.321415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:13.333088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbae78-10e2-477b-935f-62d213e58fe6 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:13.338109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:13.338693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:13.338969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:13.339235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:13.347329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:13.348929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:13.356928 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 868/1725] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:15.411521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:15.478901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797fd3-ccf8-4963-8d7f-eb5d1984b282 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:15.483485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:15.484984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.485522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.485797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] PATH_INFO: `/v3/users/60e5ac0e700d47a2a75eeaccc35b655c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.486959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e5ac0e700d47a2a75eeaccc35b655c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:15.489858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:15.520615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:15.522318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:15.539252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5328a-23e5-4391-966f-eda2139daeec service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:15.544920 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:15.545877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.546818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.547183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] PATH_INFO: `/v3/users/0f8ed34d4b774af4821303c98872e6e7` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.548441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8ed34d4b774af4821303c98872e6e7)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:15.550392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:15.554754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e5ac0e700d47a2a75eeaccc35b655c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.555508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e5ac0e700d47a2a75eeaccc35b655c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.564807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e5ac0e700d47a2a75eeaccc35b655c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.586884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e5ac0e700d47a2a75eeaccc35b655c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.587797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1f053dcf-6ed2-452f-a66c-061957f89c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e5ac0e700d47a2a75eeaccc35b655c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.602660 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 858/1726] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:15 2022] DELETE /identity/v3/users/60e5ac0e700d47a2a75eeaccc35b655c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:15.607161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.607448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.607717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.608186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8ed34d4b774af4821303c98872e6e7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.609765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8ed34d4b774af4821303c98872e6e7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.610850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8ed34d4b774af4821303c98872e6e7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.622857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8ed34d4b774af4821303c98872e6e7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.624220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:15.635471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c4f4c06e-395a-40ee-a973-5a112acde6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8ed34d4b774af4821303c98872e6e7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:15.638606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:15.640168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:15.664488 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 869/1727] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:15 2022] DELETE /identity/v3/users/0f8ed34d4b774af4821303c98872e6e7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:15.666086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.666529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.666968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.689086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:15.689841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:15.724273 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 859/1728] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:15.733768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:15.735363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:15.740930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:15.755779 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 870/1729] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:15.766329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:15.767874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:15.793505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672295-e66a-46e1-8c54-2ee55501a62e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:15.824734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820290-0c9e-4107-8987-774d303b4a51 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:15.829188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:15.829786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.830060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.830679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.839644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:15.841099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:15.841211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:15.841699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:15.841978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:15.842245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:15.850630 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 871/1730] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:15.851980 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:15.853421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:15.864160 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 860/1731] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:41:16.056104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.058026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:16.072109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74313b-c4aa-4bfd-962b-a0598e4efda6 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.091179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.092331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.092637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.093862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] PATH_INFO: `/v3/projects/aab0bf27d6c7415f9d3fc8f873a0607f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.095160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab0bf27d6c7415f9d3fc8f873a0607f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.097755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.148851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'request_id': 'req-43e3d09b-94f9-413e-a318-4bfadaee7da0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.155131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'request_id': 'req-43e3d09b-94f9-413e-a318-4bfadaee7da0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.162078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.163645 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:16.165612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'request_id': 'req-43e3d09b-94f9-413e-a318-4bfadaee7da0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.180843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7be87-c6a3-4f8e-a45c-dbc9d1b4e93e service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.183712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] The token cache is being invalidate because project aab0bf27d6c7415f9d3fc8f873a0607f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:16.184037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.184672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-43e3d09b-94f9-413e-a318-4bfadaee7da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.186173 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 872/1732] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:16 2022] DELETE /identity/v3/projects/aab0bf27d6c7415f9d3fc8f873a0607f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:16.255272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.255962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.256265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.256521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] PATH_INFO: `/v3/projects/4cb68a88f174402d8ad45065830a7d16` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.257743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb68a88f174402d8ad45065830a7d16)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.259701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.267148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:16.320988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb68a88f174402d8ad45065830a7d16', 'request_id': 'req-d16e91b5-789e-4351-8ea5-7daed02bf53d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.331441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb68a88f174402d8ad45065830a7d16', 'request_id': 'req-d16e91b5-789e-4351-8ea5-7daed02bf53d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.340223 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb68a88f174402d8ad45065830a7d16', 'request_id': 'req-d16e91b5-789e-4351-8ea5-7daed02bf53d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.356954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] The token cache is being invalidate because project 4cb68a88f174402d8ad45065830a7d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:16.357251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.357966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d16e91b5-789e-4351-8ea5-7daed02bf53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:16.360787 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 861/1733] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:16 2022] DELETE /identity/v3/projects/4cb68a88f174402d8ad45065830a7d16 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:16.365580 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.365873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.366664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.389731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:16.391062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:16.454337 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 873/1734] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:16.461625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.462127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.462234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.482892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:16.484583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:16.492980 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 862/1735] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:16.497456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.508686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065f8d-3cff-49c3-a825-30a3567ac49c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.516236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.516842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.517120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.517462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.518040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:16.518338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.521608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.534695 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 874/1736] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:16.538932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.549410 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc865753-84c8-47f6-88cd-5e30d7c8b89f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.554720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.555325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.555601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.556021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.557245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.559351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.590934 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 863/1737] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:16.595593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.607704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dac7-4713-4067-b913-2fe8945cba55 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.612713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:16.674250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.674854 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.675134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.675406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.676065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.678006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.699411 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 875/1738] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:16.704055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.714836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39b99-c434-473b-bb54-b352894c442f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.720979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.721688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.721970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.722239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.722885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.724516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.734657 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 864/1739] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:16.738987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.748903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f306e-3f63-4dab-b04f-768d088faeb0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.753845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.754444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.754723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.754994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.755635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.757270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c82951-a4a0-456b-b8c1-f384f3fd64ef admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.772081 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 876/1740] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:16.773426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.784693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205941-fdf6-4fa4-af02-8ab02e575140 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:16.789667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:16.790341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.790617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.790881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] PATH_INFO: `/v3/projects/6a2a1e697c8f4abaa798c137f992aec8/users/bc2506d5ae3c40928c57ea9d9b0c6fc7/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.805623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2a1e697c8f4abaa798c137f992aec8, user_id=bc2506d5ae3c40928c57ea9d9b0c6fc7, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:16.808285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:16.828883 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 865/1741] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:16 2022] PUT /identity/v3/projects/6a2a1e697c8f4abaa798c137f992aec8/users/bc2506d5ae3c40928c57ea9d9b0c6fc7/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:16.833281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:16.833692 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:16.833970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:16.864329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] MFA Rules not processed for user `bc2506d5ae3c40928c57ea9d9b0c6fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:16.865564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:16.930429 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 877/1742] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:16.934891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:16.996696 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291b91-6f15-40c5-a2bf-cb1ed09c6bec admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.001901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.002495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.002774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.003046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.003669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.005604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.032006 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 866/1743] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:16 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:17.036046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.046541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a09aa-b235-4935-a529-f31aeda397f8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.102732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.103331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.103607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.103897 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.104536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.106449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.128870 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 878/1744] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:17 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:17.132913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.143119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965fe4-a0c3-4003-8a30-878f50cf522c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.147656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.148281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.148563 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.148836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.149467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.151060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.162060 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 867/1745] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:17.166277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.173119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:17.177525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a941a9-b1cd-4a96-860b-79e7762d08f9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.183295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.183957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.184234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.184504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] PATH_INFO: `/v3/projects/6d298f771166491db1d4973e5f14a67c/users/1762c48da23848ec88994157282e1b18/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.198879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d298f771166491db1d4973e5f14a67c, user_id=1762c48da23848ec88994157282e1b18, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.201840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.215588 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 879/1746] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:17 2022] PUT /identity/v3/projects/6d298f771166491db1d4973e5f14a67c/users/1762c48da23848ec88994157282e1b18/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:17.220424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.226673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:17.231263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13841-7dc8-4431-a0dd-bc71bcbd6528 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.290074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.290592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.290865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.291130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.291751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.293364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0987f-695b-4426-870a-2b4b2d12d148 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.302807 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 868/1747] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:41:17.306976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.317163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6284-83e8-4edc-b6d8-0aa02f8d40dd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.321695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.322328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.322620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.322879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] PATH_INFO: `/v3/projects/6d298f771166491db1d4973e5f14a67c/users/1762c48da23848ec88994157282e1b18/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.324976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d298f771166491db1d4973e5f14a67c, user_id=1762c48da23848ec88994157282e1b18, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.328381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.338675 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 880/1748] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:17 2022] PUT /identity/v3/projects/6d298f771166491db1d4973e5f14a67c/users/1762c48da23848ec88994157282e1b18/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:17.351400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.351785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.352088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.381293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] MFA Rules not processed for user `1762c48da23848ec88994157282e1b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:17.382551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:17.448096 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 869/1749] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:17.460350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.462032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:17.520640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd09f7a-ba1e-4ebd-9c25-c5f9a301c12f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.524311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.524931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.525208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.525484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.535244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.536708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2a861-5b89-4300-a2b3-0f44a6086076 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.546188 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 881/1750] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:17.637670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:17.639353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:17.652230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaccc66-ffe9-4fa9-8124-e660cbca07da None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:17.655746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:17.656362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:17.656634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:17.656898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:17.715131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:17.716587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767d36-467d-4ba7-bdb4-c116736d94b2 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:17.725617 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 870/1751] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:23.852062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:23.852646 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:23.852830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:23.854893 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 882/1752] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:41:24.120942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:24.123619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:24.123619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:24.145951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] MFA Rules not processed for user `318bc2434e5f43439283d9419348c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:24.147482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:24.177404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:24.237278 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 871/1753] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:41:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:24.254709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:24.256688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:24.275572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353338-238b-448a-a29a-f4d7909f69e5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:24.283365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:24.284091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:24.284434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:24.284775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:24.294027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:24.295608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:24.305832 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 883/1754] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:24.728921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:24.730366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:24.797543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9650-646d-486a-b99e-9c57f3532aea None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:24.802013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:24.802624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:24.802894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:24.803161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] PATH_INFO: `/v3/users/a76e5b2b9d844730bf0c955c1c47b582` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:24.804296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76e5b2b9d844730bf0c955c1c47b582)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:24.806287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:24.853100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76e5b2b9d844730bf0c955c1c47b582'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:24.853737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76e5b2b9d844730bf0c955c1c47b582'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:24.861722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76e5b2b9d844730bf0c955c1c47b582'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:24.873722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76e5b2b9d844730bf0c955c1c47b582'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:24.874977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76e5b2b9d844730bf0c955c1c47b582'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:24.886823 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 872/1755] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:24 2022] DELETE /identity/v3/users/a76e5b2b9d844730bf0c955c1c47b582 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:25.069188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.081407 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a5ef-728a-4c40-bf4c-8b0661493d21 service placement] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:25.162786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:25.163408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.163680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.163974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] PATH_INFO: `/v3/projects/78099a2acb31422095531592b7c2da20` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.165083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78099a2acb31422095531592b7c2da20)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:25.166969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:25.225888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78099a2acb31422095531592b7c2da20', 'request_id': 'req-fbb4bf96-ad7c-43be-a64a-bfec539b5367'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.231431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78099a2acb31422095531592b7c2da20', 'request_id': 'req-fbb4bf96-ad7c-43be-a64a-bfec539b5367'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.232536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:25.238921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78099a2acb31422095531592b7c2da20', 'request_id': 'req-fbb4bf96-ad7c-43be-a64a-bfec539b5367'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.256803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] The token cache is being invalidate because project 78099a2acb31422095531592b7c2da20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:25.257161 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.257780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.259292 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 884/1756] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:25 2022] DELETE /identity/v3/projects/78099a2acb31422095531592b7c2da20 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:25.263276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.264972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:25.277886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7b278-6c47-410e-8c3d-d5766d5bf603 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:25.319455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:25.341507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:25.342240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.342518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.342783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] PATH_INFO: `/v3/users/86c653c37aad46b49eaca8158da8f1d8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.344905 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c653c37aad46b49eaca8158da8f1d8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:25.346909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:25.396337 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c653c37aad46b49eaca8158da8f1d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.397004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c653c37aad46b49eaca8158da8f1d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.406295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c653c37aad46b49eaca8158da8f1d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.418832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c653c37aad46b49eaca8158da8f1d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.419514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66e32f58-5ac3-4217-b0db-5cf280a38acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c653c37aad46b49eaca8158da8f1d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.435363 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 873/1757] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:25 2022] DELETE /identity/v3/users/86c653c37aad46b49eaca8158da8f1d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:25.605524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.607150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:25.628802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4bf96-ad7c-43be-a64a-bfec539b5367 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:25.694213 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:25.694838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.695134 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.695405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] PATH_INFO: `/v3/projects/0f515e217ddc434192f81acd16acd7e9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.696583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f515e217ddc434192f81acd16acd7e9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:25.698524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:25.747478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f515e217ddc434192f81acd16acd7e9', 'request_id': 'req-20106670-b47c-434e-b329-bc25455eec49'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.753520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f515e217ddc434192f81acd16acd7e9', 'request_id': 'req-20106670-b47c-434e-b329-bc25455eec49'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.760079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f515e217ddc434192f81acd16acd7e9', 'request_id': 'req-20106670-b47c-434e-b329-bc25455eec49'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.773572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] The token cache is being invalidate because project 0f515e217ddc434192f81acd16acd7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:25.773860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.774485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-20106670-b47c-434e-b329-bc25455eec49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:25.776013 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 885/1758] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:25 2022] DELETE /identity/v3/projects/0f515e217ddc434192f81acd16acd7e9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:25.781693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.782036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.782408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.802585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:25.803786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:25.861816 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 874/1759] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:25.870136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.870424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.870695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.891352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:25.892584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:25.900365 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 886/1760] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:25.904558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.914097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e05d9-6b31-4566-8176-300f144090a3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:25.918592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:25.919176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.919453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.919722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.920406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:25.920707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:25.922402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:25.933639 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 875/1761] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:25.938402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.947679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77ed7-c771-49dd-a0b3-12dd8b4f1183 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:25.953540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:25.953540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:25.954627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:25.954627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:25.954627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:25.956600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:25.984383 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 887/1762] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:25 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:25.988991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:25.999588 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2c494-494b-4e63-9053-79c1cdb369d5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.042071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:26.056118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.056714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.056994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.057264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.057898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.059818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.080618 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 876/1763] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:25 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:41:26.084834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.096332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fd82-a2cb-445a-a9c4-15360ed2d249 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.100980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.101561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.101861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.102128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.102758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.104396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.114553 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 888/1764] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:26.118480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.129191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d28507-74e1-4738-9083-9706a0ba3470 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.133710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.134298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.134576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.134845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.135503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.137114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5f422-bc5a-4851-b6b5-c6968ad84088 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.148136 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 877/1765] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:26.152127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.161818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4278ee-adcf-4c30-892b-2672d88e3c42 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.166449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.167143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.167421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.167724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] PATH_INFO: `/v3/projects/8696a13975004a15b82014d83816044f/users/31002e5dc0ef4311ac6277abb6da5890/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.182128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8696a13975004a15b82014d83816044f, user_id=31002e5dc0ef4311ac6277abb6da5890, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.184797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.198127 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 889/1766] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:26 2022] PUT /identity/v3/projects/8696a13975004a15b82014d83816044f/users/31002e5dc0ef4311ac6277abb6da5890/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:26.209445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.209727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.209996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.239321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] MFA Rules not processed for user `31002e5dc0ef4311ac6277abb6da5890`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:26.240587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:26.306109 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 878/1767] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:26.310664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.325058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:26.378091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008b9e1-db92-4f3e-ae52-6cb2ef140396 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.382921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.383515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.383792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.384088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.384816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.386696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.420579 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 890/1768] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:26 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:26.421847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.432466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ad903-2d95-428c-8515-f264e89a2a21 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.494047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.494639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.494963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.495279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.496566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.497881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.530251 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 879/1769] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:26 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:26.534981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.545548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36f317-f672-49f2-a231-866a701bc589 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.553573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.554392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.554738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.555223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.556037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.557648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.574471 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 891/1770] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:26.575640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.588375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a55d8-311d-4b6e-9a82-546c814ea27b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.591906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.592590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.592892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.593179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] PATH_INFO: `/v3/projects/8b91e744554a4e28aa3facbe4132c5b9/users/a0e3c5b376404948b1283c0e932bbc57/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.611616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91e744554a4e28aa3facbe4132c5b9, user_id=a0e3c5b376404948b1283c0e932bbc57, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.614964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.633263 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 880/1771] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:26 2022] PUT /identity/v3/projects/8b91e744554a4e28aa3facbe4132c5b9/users/a0e3c5b376404948b1283c0e932bbc57/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:26.637273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.648218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054cdf4-a0e0-4e61-81c2-ad84d1cdcee5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.707493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.708177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.708447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.708714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.709398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.710985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e259-4202-439d-a5cb-ec209464a613 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.721181 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 892/1772] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:26.725474 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.737372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb89dc4-5712-48af-9ca9-7e00b79b5e07 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.742177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.742824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.743101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.743373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] PATH_INFO: `/v3/projects/8b91e744554a4e28aa3facbe4132c5b9/users/a0e3c5b376404948b1283c0e932bbc57/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.745293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91e744554a4e28aa3facbe4132c5b9, user_id=a0e3c5b376404948b1283c0e932bbc57, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.747954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.758797 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 881/1773] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:26 2022] PUT /identity/v3/projects/8b91e744554a4e28aa3facbe4132c5b9/users/a0e3c5b376404948b1283c0e932bbc57/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:26.771247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.771554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.771838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.802153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] MFA Rules not processed for user `a0e3c5b376404948b1283c0e932bbc57`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:26.803389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:26.872342 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 893/1774] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:26.883028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.884803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:26.895015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:26.944712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab29fa-c38a-414b-8b00-37a55ff98590 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.948339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.948936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.949215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.949485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:27.005658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:27.007087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:27.015677 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 882/1775] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:31.243350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:31.244747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:31.256270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16453e9c-af96-4fa1-b9b4-4b96813c59b0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:31.259659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:31.260283 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:31.260556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:31.260818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:31.267455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:31.270088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:31.271923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6ff6e-0c4d-4e53-9776-2fc255495fc0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:31.282949 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 894/1776] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:36.162760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:36.224338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e5ef-5209-4085-8573-e51547dd92e5 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:36.228971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:36.229620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:36.229893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:36.230159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] PATH_INFO: `/v3/users/31002e5dc0ef4311ac6277abb6da5890` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:36.231286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=31002e5dc0ef4311ac6277abb6da5890)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:36.233231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:36.278844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31002e5dc0ef4311ac6277abb6da5890'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.279493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31002e5dc0ef4311ac6277abb6da5890'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.287416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31002e5dc0ef4311ac6277abb6da5890'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.294321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:36.302732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31002e5dc0ef4311ac6277abb6da5890'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.303458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31002e5dc0ef4311ac6277abb6da5890'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.318005 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 883/1777] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:36 2022] DELETE /identity/v3/users/31002e5dc0ef4311ac6277abb6da5890 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:36.322370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:36.323168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:36.323534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:36.344048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:36.345262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:36.405054 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 895/1778] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:36.414964 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:36.416542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:36.479334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf39dcd-15a0-4b27-b49f-55c8a9cb5cac admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:36.483066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:36.483742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:36.484049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:36.484324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:36.493945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:36.495365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:36.508915 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 884/1779] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:36.876166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:36.878113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:36.894510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a238a8-983a-453e-bb11-29e773aef167 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:36.899973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:36.900597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:36.900870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:36.901136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] PATH_INFO: `/v3/projects/8696a13975004a15b82014d83816044f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:36.908681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8696a13975004a15b82014d83816044f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:36.910780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:36.960914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8696a13975004a15b82014d83816044f', 'request_id': 'req-084b7162-7e53-44be-a123-f94e0ba517bf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.966377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8696a13975004a15b82014d83816044f', 'request_id': 'req-084b7162-7e53-44be-a123-f94e0ba517bf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.973047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8696a13975004a15b82014d83816044f', 'request_id': 'req-084b7162-7e53-44be-a123-f94e0ba517bf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.986730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] The token cache is being invalidate because project 8696a13975004a15b82014d83816044f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:36.987008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.987622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:36.989218 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 896/1780] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:36 2022] DELETE /identity/v3/projects/8696a13975004a15b82014d83816044f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:36.993212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.003513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecbb6f-99d4-4d3e-a9bc-9cdbbcd541ea service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.058247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.058786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.059061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.059332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] PATH_INFO: `/v3/users/a0e3c5b376404948b1283c0e932bbc57` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.060443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e3c5b376404948b1283c0e932bbc57)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.063094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.110016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e3c5b376404948b1283c0e932bbc57'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.111036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e3c5b376404948b1283c0e932bbc57'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.118892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e3c5b376404948b1283c0e932bbc57'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.130783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e3c5b376404948b1283c0e932bbc57'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.131409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7b801a1b-d104-4cf4-af46-8aa981178cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e3c5b376404948b1283c0e932bbc57'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.143470 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 885/1781] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:36 2022] DELETE /identity/v3/users/a0e3c5b376404948b1283c0e932bbc57 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:37.416244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.417705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:37.431650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b7162-7e53-44be-a123-f94e0ba517bf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.491951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.492577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.492853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.493122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] PATH_INFO: `/v3/projects/8b91e744554a4e28aa3facbe4132c5b9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.494223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b91e744554a4e28aa3facbe4132c5b9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.496197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.520660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:37.546367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b91e744554a4e28aa3facbe4132c5b9', 'request_id': 'req-631357c2-fe96-40b1-a5cd-13020c7026e8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.552152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b91e744554a4e28aa3facbe4132c5b9', 'request_id': 'req-631357c2-fe96-40b1-a5cd-13020c7026e8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.559564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b91e744554a4e28aa3facbe4132c5b9', 'request_id': 'req-631357c2-fe96-40b1-a5cd-13020c7026e8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.573081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] The token cache is being invalidate because project 8b91e744554a4e28aa3facbe4132c5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:37.573418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.574044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-631357c2-fe96-40b1-a5cd-13020c7026e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:37.575780 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 897/1782] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:37 2022] DELETE /identity/v3/projects/8b91e744554a4e28aa3facbe4132c5b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:37.582432 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.582943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.583062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.590743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:37.606126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:37.607372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:37.669710 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 886/1783] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:37.679391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.679671 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.679972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.699733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:37.700963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:37.709936 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 898/1784] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:37.714680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.724877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433ed3a-bc11-438d-995a-3ce5c6762fe4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.729459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.730036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.730317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.730582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.731510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:37.731819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.733517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.749154 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 887/1785] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:41:37.754006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.763668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efa7e9-9610-4a70-9bdc-63451e158687 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.770036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.770821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.771163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.771548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.772284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.774285 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.805206 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 899/1786] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:37 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:37.808218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.823091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f927f1-0cc2-48fa-bcb0-51780920dae0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.884181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.884717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.885004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.885269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.885994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.888064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.914217 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 888/1787] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:37 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:37.918484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.937558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64ca0-b5f7-4f72-824e-d4163745632f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.944879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.945689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.946104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.946566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.947364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.949157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.960609 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 900/1788] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:41:37.964963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:37.976008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aac422-ac7a-4693-b5c2-7e362db70582 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:37.981019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:37.981628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:37.981906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:37.982178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:37.982820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:37.984791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1db133-10ab-4626-af64-5d252bbd589b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:37.996472 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 889/1789] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:38.002400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.012752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cbb7-e447-4579-aeb7-a99660d02419 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.018487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.019146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.024149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.024540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] PATH_INFO: `/v3/projects/1e09949eafa64eb5a07679e480b8712d/users/9695b53104d74b2884717b58ecce2563/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.041881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e09949eafa64eb5a07679e480b8712d, user_id=9695b53104d74b2884717b58ecce2563, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.044748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.061137 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 901/1790] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:38 2022] PUT /identity/v3/projects/1e09949eafa64eb5a07679e480b8712d/users/9695b53104d74b2884717b58ecce2563/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:38.073140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.073455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.073724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.106082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] MFA Rules not processed for user `9695b53104d74b2884717b58ecce2563`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:38.107537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:38.168558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:38.175118 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 890/1791] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:38.179539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.241362 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df804-e4ad-4cc0-a543-7995b31658a6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.245944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.246533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.246810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.247079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.247706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.250358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.276824 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 902/1792] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:38.281085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.291868 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e268-50a3-49ff-9e56-7bea9abe06ce None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.350074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.350674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.350946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.351210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.351825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.353953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.375648 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 891/1793] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:38.379611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.389803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e331e0-e277-4ee5-9adb-9be9af12af12 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.394348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.394935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.395214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.395486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.396170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.397776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.410904 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 903/1794] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:38.412731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.423455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733fb6e-fb75-4492-ba58-abc00884fff1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.428145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.428776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.429061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.429331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] PATH_INFO: `/v3/projects/a6ceff2d4641426f978956bb88f10ef4/users/cc329554eac147b1a4d426610330067b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.444618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ceff2d4641426f978956bb88f10ef4, user_id=cc329554eac147b1a4d426610330067b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.447292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.460537 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 892/1795] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:38 2022] PUT /identity/v3/projects/a6ceff2d4641426f978956bb88f10ef4/users/cc329554eac147b1a4d426610330067b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:38.464233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.474635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab705-b1d3-4c2e-8380-1de599a22f37 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.491926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:38.535416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.536029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.536303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.536568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.537192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.538775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50186b-6eb9-4054-9ed8-81afccced2e0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.549702 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 904/1796] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:38.553712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.564815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641369-9277-4317-9423-ae1f66c9daf6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.569392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.570008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.570284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.570572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] PATH_INFO: `/v3/projects/a6ceff2d4641426f978956bb88f10ef4/users/cc329554eac147b1a4d426610330067b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.572470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ceff2d4641426f978956bb88f10ef4, user_id=cc329554eac147b1a4d426610330067b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.575081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.585125 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 893/1797] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:38 2022] PUT /identity/v3/projects/a6ceff2d4641426f978956bb88f10ef4/users/cc329554eac147b1a4d426610330067b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:38.596911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.597194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.597466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.627744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] MFA Rules not processed for user `cc329554eac147b1a4d426610330067b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:38.628970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:38.699284 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 905/1798] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:38.710766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:38.712723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:38.770080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f875-1e5f-4b85-a049-9156bf085d64 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:38.773765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:38.774364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:38.774642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:38.774915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:38.830647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:38.832116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3dc1a-65dc-44d7-8d2d-aa76cac1fcab service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:38.840879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 894/1799] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:41.439073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:41.501382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a340af-6870-437f-bcce-9406cf2e5dad None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:41.505779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:41.506410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:41.506685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:41.506953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] PATH_INFO: `/v3/users/9695b53104d74b2884717b58ecce2563` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:41.508083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9695b53104d74b2884717b58ecce2563)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:41.509984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:41.559261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:41.562970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9695b53104d74b2884717b58ecce2563'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:41.564032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9695b53104d74b2884717b58ecce2563'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:41.565089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9695b53104d74b2884717b58ecce2563'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:41.573065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9695b53104d74b2884717b58ecce2563'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:41.583749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9695b53104d74b2884717b58ecce2563'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:41.607922 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 906/1800] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:41 2022] DELETE /identity/v3/users/9695b53104d74b2884717b58ecce2563 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:41.622085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:41.622594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:41.622685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:41.631251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:41.645909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:41.648162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:41.724890 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 895/1801] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:41.740639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:41.742043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:41.806768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de007d-e875-4c99-84e7-ed05f5454396 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:41.810452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:41.811051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:41.811323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:41.811612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:41.820843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:41.822260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:41.831911 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 907/1802] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:42.120769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:42.122210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:42.135029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94efbc4-cd49-47cb-94cb-4ac5cb0934c5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:42.139681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:42.140345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.140623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.140895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] PATH_INFO: `/v3/projects/1e09949eafa64eb5a07679e480b8712d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.142014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e09949eafa64eb5a07679e480b8712d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:42.144007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:42.192685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e09949eafa64eb5a07679e480b8712d', 'request_id': 'req-3c39458e-53c0-4564-887b-54f6322869f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.198216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e09949eafa64eb5a07679e480b8712d', 'request_id': 'req-3c39458e-53c0-4564-887b-54f6322869f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.205037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e09949eafa64eb5a07679e480b8712d', 'request_id': 'req-3c39458e-53c0-4564-887b-54f6322869f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.217429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] The token cache is being invalidate because project 1e09949eafa64eb5a07679e480b8712d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:42.217737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.218849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.220387 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 896/1803] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:42 2022] DELETE /identity/v3/projects/1e09949eafa64eb5a07679e480b8712d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:42.224379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:42.234833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124894be-2486-484b-ad54-ddd4b45e3cdf service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:42.290748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:42.291369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.291648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.291976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] PATH_INFO: `/v3/users/cc329554eac147b1a4d426610330067b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.293090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc329554eac147b1a4d426610330067b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:42.295006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:42.341871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc329554eac147b1a4d426610330067b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.342509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc329554eac147b1a4d426610330067b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.343633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc329554eac147b1a4d426610330067b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.351970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc329554eac147b1a4d426610330067b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.359685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-08b4b7dc-f78b-404a-895f-c44a57764b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc329554eac147b1a4d426610330067b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.361807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:42.379521 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 908/1804] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:42 2022] DELETE /identity/v3/users/cc329554eac147b1a4d426610330067b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:42.643220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:42.644721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:42.658530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39458e-53c0-4564-887b-54f6322869f7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:42.717681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:42.719632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.719939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.720214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] PATH_INFO: `/v3/projects/a6ceff2d4641426f978956bb88f10ef4` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.721420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ceff2d4641426f978956bb88f10ef4)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:42.723262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:42.766276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:42.778943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ceff2d4641426f978956bb88f10ef4', 'request_id': 'req-c7f7a626-125e-478e-9e77-f22824cc714d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.786216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ceff2d4641426f978956bb88f10ef4', 'request_id': 'req-c7f7a626-125e-478e-9e77-f22824cc714d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.793628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ceff2d4641426f978956bb88f10ef4', 'request_id': 'req-c7f7a626-125e-478e-9e77-f22824cc714d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.812416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] The token cache is being invalidate because project a6ceff2d4641426f978956bb88f10ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:42.812416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.813019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c7f7a626-125e-478e-9e77-f22824cc714d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:42.814814 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 897/1805] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:42 2022] DELETE /identity/v3/projects/a6ceff2d4641426f978956bb88f10ef4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:42.819734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.820261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.820544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.847701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:42.849479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:42.919645 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 909/1806] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:42.927732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.928318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.928601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.949068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:42.950250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:42.958999 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 898/1807] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:42.963229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:42.975354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2441e-e076-4ea9-b90e-8a6db65cd40b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:42.980220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:42.980823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:42.981099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:42.981358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:42.981996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:42.982380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:42.984147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:42.999898 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 910/1808] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:43.002675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.011791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605ecf-3286-464b-863c-69493a35cb1e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.017875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.018479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.018755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.019024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.019652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.021714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.057122 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 899/1809] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:43 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:43.061374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.073102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e561d5-8799-463c-91a0-08492647eda5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.139162 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.140604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.141236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.141513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.142155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.144194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.169246 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 911/1810] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:43 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:41:43.170968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.181407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62fe54-e8b6-444f-84c9-d36e9111888d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.185983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.187087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.187437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.187703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.188392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.190000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.200396 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 900/1811] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:43.205311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.215547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abb39-0406-4304-ab9b-ab82470ef826 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.220808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.221400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.221675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.221940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.222729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.224187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad9e6a-be09-48ee-bee0-d3ecd2876966 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.236482 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 912/1812] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:43.240742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.251125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec578-7f34-47ea-ac10-745331dba145 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.255970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.256625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.257008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.257196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] PATH_INFO: `/v3/projects/3b24d4afc5104b359924acdf4619cfc7/users/bb1e83f51a384b7d9d044bce87f00990/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.284370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b24d4afc5104b359924acdf4619cfc7, user_id=bb1e83f51a384b7d9d044bce87f00990, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.288058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.334937 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 901/1813] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:43 2022] PUT /identity/v3/projects/3b24d4afc5104b359924acdf4619cfc7/users/bb1e83f51a384b7d9d044bce87f00990/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:43.340074 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914029-b5ec-42ca-860c-539c4059d1c0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.340364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914029-b5ec-42ca-860c-539c4059d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.340689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914029-b5ec-42ca-860c-539c4059d1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.361581 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c9914029-b5ec-42ca-860c-539c4059d1c0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:43.362780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c9914029-b5ec-42ca-860c-539c4059d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:43.405911 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:43.423740 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 913/1814] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:43.433394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.435188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:43.491132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d099f-28e7-4372-8ff7-920a253dd234 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.494708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.495303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.495582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.495875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.504738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.506154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.516041 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 902/1815] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:44.147803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420b57-f87d-40ee-9bb5-503d403fa272 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.148321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420b57-f87d-40ee-9bb5-503d403fa272 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.148430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420b57-f87d-40ee-9bb5-503d403fa272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.178230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-39420b57-f87d-40ee-9bb5-503d403fa272 None None] MFA Rules not processed for user `bb1e83f51a384b7d9d044bce87f00990`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:44.179474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-39420b57-f87d-40ee-9bb5-503d403fa272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:44.256944 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 914/1816] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:44.269313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:44.270892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:44.336473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6b4f-5375-47a0-b82c-006e066559ea service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:44.340177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:44.340779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.341055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.341323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.351471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:44.352943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:44.357552 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:44.363229 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 903/1817] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:45.836727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17790-e20b-4446-9a4a-0c92949f721c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:45.837331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17790-e20b-4446-9a4a-0c92949f721c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:45.837331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17790-e20b-4446-9a4a-0c92949f721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:45.859071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9ba17790-e20b-4446-9a4a-0c92949f721c None None] MFA Rules not processed for user `bb1e83f51a384b7d9d044bce87f00990`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:45.859994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9ba17790-e20b-4446-9a4a-0c92949f721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:45.867345 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 915/1818] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:48.767054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:48.768669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:48.785680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75acc6-52f6-45eb-a649-48574d8819fb service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:48.790358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:48.790952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:48.791231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:48.791502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] PATH_INFO: `/v3/users/bc2506d5ae3c40928c57ea9d9b0c6fc7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:48.792711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2506d5ae3c40928c57ea9d9b0c6fc7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:48.794626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:48.847283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2506d5ae3c40928c57ea9d9b0c6fc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:48.847872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2506d5ae3c40928c57ea9d9b0c6fc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:48.856069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2506d5ae3c40928c57ea9d9b0c6fc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:48.870644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2506d5ae3c40928c57ea9d9b0c6fc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:48.871339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2506d5ae3c40928c57ea9d9b0c6fc7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:48.887249 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 904/1819] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:48 2022] DELETE /identity/v3/users/bc2506d5ae3c40928c57ea9d9b0c6fc7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:48.889148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:48.889779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:48.889779 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:48.908770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:48.909985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:48.971571 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 916/1820] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:48.981104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:48.982630 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:49.044802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ecb6-2076-4271-a7ea-c43b9fbbe19e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:49.050131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:49.050740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:49.051019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:49.051369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:49.063318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:49.064847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:49.076470 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 905/1821] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:49.529002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:49.531143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:49.547292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a0dba-b4d3-4674-be63-f301a4fb3ac5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:49.553160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:49.554062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:49.554461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:49.554848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] PATH_INFO: `/v3/projects/6a2a1e697c8f4abaa798c137f992aec8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:49.556270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2a1e697c8f4abaa798c137f992aec8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:49.558300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:49.606735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2a1e697c8f4abaa798c137f992aec8', 'request_id': 'req-265fe82c-c786-4beb-b84a-a38540f273cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.613684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2a1e697c8f4abaa798c137f992aec8', 'request_id': 'req-265fe82c-c786-4beb-b84a-a38540f273cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.623556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2a1e697c8f4abaa798c137f992aec8', 'request_id': 'req-265fe82c-c786-4beb-b84a-a38540f273cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.627967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:49.639278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] The token cache is being invalidate because project 6a2a1e697c8f4abaa798c137f992aec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:49.640149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.640945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.642464 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 917/1822] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:49 2022] DELETE /identity/v3/projects/6a2a1e697c8f4abaa798c137f992aec8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:49.646532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:49.656574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550794-44f0-4535-af1a-c1415dcf1314 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:49.712633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:49.713248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:49.713521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:49.713785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] PATH_INFO: `/v3/users/1762c48da23848ec88994157282e1b18` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:49.714869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1762c48da23848ec88994157282e1b18)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:49.717113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:49.732802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:49.763787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1762c48da23848ec88994157282e1b18'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.764457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1762c48da23848ec88994157282e1b18'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.779590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1762c48da23848ec88994157282e1b18'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.792894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1762c48da23848ec88994157282e1b18'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.793527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-26c4c5c6-7185-4281-910f-15d8611e1f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1762c48da23848ec88994157282e1b18'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:49.805829 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 906/1823] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:49 2022] DELETE /identity/v3/users/1762c48da23848ec88994157282e1b18 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:50.082925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.085232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:50.104553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe82c-c786-4beb-b84a-a38540f273cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.169276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.169930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.170347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.170656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] PATH_INFO: `/v3/projects/6d298f771166491db1d4973e5f14a67c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.172479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d298f771166491db1d4973e5f14a67c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.174401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.221511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d298f771166491db1d4973e5f14a67c', 'request_id': 'req-a87579ed-3efb-45f5-9f45-b06445a76428'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:50.227400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d298f771166491db1d4973e5f14a67c', 'request_id': 'req-a87579ed-3efb-45f5-9f45-b06445a76428'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:50.233734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d298f771166491db1d4973e5f14a67c', 'request_id': 'req-a87579ed-3efb-45f5-9f45-b06445a76428'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:50.246443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] The token cache is being invalidate because project 6d298f771166491db1d4973e5f14a67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:50.246737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:50.247359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a87579ed-3efb-45f5-9f45-b06445a76428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:50.248867 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 918/1824] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:50 2022] DELETE /identity/v3/projects/6d298f771166491db1d4973e5f14a67c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:50.253688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.253979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.254257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.273790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:50.274990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:50.334207 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 907/1825] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:50.342371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.343417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.343791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.364940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:50.366154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:50.374265 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 919/1826] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:50.378713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.388333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a6fe0-363d-446b-ac1a-ebd102be97e8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.393889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.394489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.394766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.395034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.395678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:50.396009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.397605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.410282 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 908/1827] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:50.414659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.424845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f3ca-3790-4907-8642-969b792fbc87 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.429751 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.430349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.430626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.430918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.431558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.433506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.466615 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 920/1828] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:50.468251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.478122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3660e6-b54e-49fb-9b77-4a13ab1db4a3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.533073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.533687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.533958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.534224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.534851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.536785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.557445 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 909/1829] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:41:50.562383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.572666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69d1f-c143-4e62-bf29-0dc28f2895ba admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.577322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.577995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.578291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.578545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.579180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.580798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.590644 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 921/1830] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:50.595291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.605316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d7ea0-df6f-4f43-85ce-98c6702f24e2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.610581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.611454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.611896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.612065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.612665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.614262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483421a-4c3f-4de0-a330-bd4464daea7b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.620493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:50.626677 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 910/1831] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:50.630636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.641864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220c5dc-724c-4d54-832a-a189486df4ea admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.646571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.647211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.647489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.647759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] PATH_INFO: `/v3/projects/1bb3eafb0eb148aabafe0bd81de54213/users/3d2a9ae4cad34958b58dd209f48a9121/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.663329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb3eafb0eb148aabafe0bd81de54213, user_id=3d2a9ae4cad34958b58dd209f48a9121, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.665926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.679000 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 922/1832] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:50 2022] PUT /identity/v3/projects/1bb3eafb0eb148aabafe0bd81de54213/users/3d2a9ae4cad34958b58dd209f48a9121/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:50.690547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.690854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.691125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.722181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] MFA Rules not processed for user `3d2a9ae4cad34958b58dd209f48a9121`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:50.723395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:50.790724 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 911/1833] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:50.795413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.821866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:50.860268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0c15-06ce-4d33-8fce-2bcb8d278783 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.865164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.865764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.866041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.866311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.866946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.868875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.896333 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 923/1834] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:50.900441 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:50.912032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd7bbc-180b-4aa5-9c2c-ee724e963ba4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:50.970962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:50.971577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:50.971873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:50.972159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:50.972793 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:50.974712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:50.998854 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 912/1835] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:50 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:51.000380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:51.010460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92745b-3760-4141-9e6f-bf0501d5801c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:51.016770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:51.017370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.017720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.018004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.018643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:51.020512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:51.032316 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 924/1836] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:51.036757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:51.052437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644a32-3f7d-40fa-a889-73168cbc6376 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:51.057394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:51.058078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.058363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.058634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] PATH_INFO: `/v3/projects/aa73e7336214419ba4f6175718f1c44c/users/26509ac7551447beb66ed6e876b0c24d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.074159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa73e7336214419ba4f6175718f1c44c, user_id=26509ac7551447beb66ed6e876b0c24d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:51.077933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:51.092589 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 913/1837] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:51 2022] PUT /identity/v3/projects/aa73e7336214419ba4f6175718f1c44c/users/26509ac7551447beb66ed6e876b0c24d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:51.097487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:51.108760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61836c-ede3-4a5b-8cc8-6bad839c40de admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:51.164891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:51.165494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.165771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.166043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.166674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:51.168308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aad15-737c-4237-8bbe-90edf60a6a07 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:51.177877 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 925/1838] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:41:51.182022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:51.193093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1e79-d854-46ea-ad70-f9da52933d06 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:51.197991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:51.198656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.198933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.199269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] PATH_INFO: `/v3/projects/aa73e7336214419ba4f6175718f1c44c/users/26509ac7551447beb66ed6e876b0c24d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.201109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa73e7336214419ba4f6175718f1c44c, user_id=26509ac7551447beb66ed6e876b0c24d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:51.204377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:51.214739 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 914/1839] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:51 2022] PUT /identity/v3/projects/aa73e7336214419ba4f6175718f1c44c/users/26509ac7551447beb66ed6e876b0c24d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:51.226178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.226494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.226780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.258770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] MFA Rules not processed for user `26509ac7551447beb66ed6e876b0c24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:51.260005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:51.332480 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 926/1840] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:51.344387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:51.346068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:51.392161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:51.404682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ee6e-6dd2-4c30-97c0-2d74fcd27e3d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:51.408969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:51.409566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:51.409840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:51.410137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:51.418864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:51.420403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d092762-416b-4091-8e88-8c2f9f0664ef service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:51.430527 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 915/1841] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:52.886313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:52.907254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:52.954402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64c02-70ac-445f-94d5-11c4d8ebc2d6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:52.959205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:52.959831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:52.960193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:52.960465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] PATH_INFO: `/v3/users/3d2a9ae4cad34958b58dd209f48a9121` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:52.961603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2a9ae4cad34958b58dd209f48a9121)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:52.963512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:53.015506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2a9ae4cad34958b58dd209f48a9121'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.016850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2a9ae4cad34958b58dd209f48a9121'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.017789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2a9ae4cad34958b58dd209f48a9121'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.025793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2a9ae4cad34958b58dd209f48a9121'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.034079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2a9ae4cad34958b58dd209f48a9121'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.056259 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 927/1842] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:52 2022] DELETE /identity/v3/users/3d2a9ae4cad34958b58dd209f48a9121 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:53.061916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:53.062881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:53.063343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:53.091691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:53.096199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:53.162904 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 916/1843] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:53.173798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:53.175236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:53.240072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc782a5-d5c6-44f0-b415-7b4314ef44bd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:53.243715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:53.244363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:53.244644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:53.244916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:53.253904 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:53.255335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:53.265561 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 928/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:53.539942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:53.541390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:53.553763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c99b1a-ec62-4959-8056-2ff18dcb7f69 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:53.559184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:53.559824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:53.560191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:53.560451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] PATH_INFO: `/v3/projects/1bb3eafb0eb148aabafe0bd81de54213` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:53.563014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb3eafb0eb148aabafe0bd81de54213)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:53.565148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:53.618072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb3eafb0eb148aabafe0bd81de54213', 'request_id': 'req-f6700ea9-d77a-42ad-947a-473ed74e7314'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.623626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb3eafb0eb148aabafe0bd81de54213', 'request_id': 'req-f6700ea9-d77a-42ad-947a-473ed74e7314'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.630780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb3eafb0eb148aabafe0bd81de54213', 'request_id': 'req-f6700ea9-d77a-42ad-947a-473ed74e7314'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.644801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] The token cache is being invalidate because project 1bb3eafb0eb148aabafe0bd81de54213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:53.645088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.645715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.647480 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 917/1845] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:53 2022] DELETE /identity/v3/projects/1bb3eafb0eb148aabafe0bd81de54213 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:53.651319 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:53.661456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663547-8bb2-47dd-966d-29cf6fb1a038 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:53.701263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:53.722396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:53.723027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:53.723326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:53.723598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] PATH_INFO: `/v3/users/26509ac7551447beb66ed6e876b0c24d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:53.724741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26509ac7551447beb66ed6e876b0c24d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:53.726688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:53.775355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26509ac7551447beb66ed6e876b0c24d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.776034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26509ac7551447beb66ed6e876b0c24d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.776634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26509ac7551447beb66ed6e876b0c24d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.783885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26509ac7551447beb66ed6e876b0c24d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.791002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5032a68f-0e64-4bff-8266-624e351d0448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26509ac7551447beb66ed6e876b0c24d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:53.809265 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 929/1846] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:41:53 2022] DELETE /identity/v3/users/26509ac7551447beb66ed6e876b0c24d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:54.088327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.090464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:54.108829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700ea9-d77a-42ad-947a-473ed74e7314 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.166812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.167459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.167737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.168399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] PATH_INFO: `/v3/projects/aa73e7336214419ba4f6175718f1c44c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.169174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa73e7336214419ba4f6175718f1c44c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.171787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.183732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:54.234141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa73e7336214419ba4f6175718f1c44c', 'request_id': 'req-3d8e8a22-0a28-4163-9c41-c83bd725f60c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:54.240541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa73e7336214419ba4f6175718f1c44c', 'request_id': 'req-3d8e8a22-0a28-4163-9c41-c83bd725f60c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:54.247290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa73e7336214419ba4f6175718f1c44c', 'request_id': 'req-3d8e8a22-0a28-4163-9c41-c83bd725f60c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:54.260597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] The token cache is being invalidate because project aa73e7336214419ba4f6175718f1c44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:41:54.260988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:54.261606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d8e8a22-0a28-4163-9c41-c83bd725f60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:41:54.263094 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 918/1847] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:41:54 2022] DELETE /identity/v3/projects/aa73e7336214419ba4f6175718f1c44c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:54.268128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.268600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.268827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.290359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:54.291566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:54.360600 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 930/1848] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:54.369296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.369720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.370071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.390217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:54.391525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:54.400589 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 919/1849] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:54.404847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.415425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49587893-e0c4-4215-a501-5543d123ed7f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.422300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.422976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.423356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.423778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.424566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:41:54.424924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.426513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.450530 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 931/1850] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:41:54.451810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.461373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb994-d5bf-4a0b-bfd4-361ca9750cc8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.466973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.467572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.468415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.468688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.469326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.471237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.503266 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 920/1851] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:54.504446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.514620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fcca3-e933-493f-8708-48087d1110e1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.564520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:54.582182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.582797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.583078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.583353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.584028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.585955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.611988 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 932/1852] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:54.615879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.630678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af3ca-8694-4e19-ab60-42f4c773df59 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.635593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.636243 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.636529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.636924 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.637605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.639374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.650560 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 921/1853] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:54.654770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.667069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e16fc-9253-49ea-ac91-03df71ba1b89 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.672857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.673403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.673685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.673957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.674603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.676241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abed24-a1b1-4170-b355-aa66a98a0e39 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.687734 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 933/1854] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:54.692824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.704818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539865-a820-42cf-95ce-c8cf90ccc7ab admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.709611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.710262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.710542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.710814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] PATH_INFO: `/v3/projects/24bd7aae3494499090b08b1dff6b6f8b/users/13539f75fd5e425aba76c4f3b12bd351/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.728785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bd7aae3494499090b08b1dff6b6f8b, user_id=13539f75fd5e425aba76c4f3b12bd351, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.731576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.757158 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 922/1855] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:54 2022] PUT /identity/v3/projects/24bd7aae3494499090b08b1dff6b6f8b/users/13539f75fd5e425aba76c4f3b12bd351/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:54.769627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.769919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.770188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.803557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] MFA Rules not processed for user `13539f75fd5e425aba76c4f3b12bd351`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:54.804831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:54.883057 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 934/1856] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:54.887756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:54.957354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af434d-72d3-4699-9f19-336620a04bc3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:54.961970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:54.962567 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:54.962971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:54.963239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:54.963908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:54.965807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:54.993538 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 923/1857] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:54.997598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.008637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59647db-0333-48d3-b02e-76b01eeecc32 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.067656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.068293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.068567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.068832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.069455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.071358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.097069 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 935/1858] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:41:54 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:41:55.098406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.108944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5354d4-688c-41e9-8393-4d4235e60594 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.113959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.114675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.114959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.115232 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.115906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.117513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.130514 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 924/1859] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:55.134727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.145770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8fd7-cf50-4b42-8c19-9bfc18365da2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.150476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.151257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.151598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.151798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] PATH_INFO: `/v3/projects/a7e84de6fa9f4beda775793acaf92b5e/users/af09cc47d0ed43f6be0239d647df97e4/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.167873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e84de6fa9f4beda775793acaf92b5e, user_id=af09cc47d0ed43f6be0239d647df97e4, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.170616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.189052 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 936/1860] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:55 2022] PUT /identity/v3/projects/a7e84de6fa9f4beda775793acaf92b5e/users/af09cc47d0ed43f6be0239d647df97e4/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:41:55.192967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.203729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194c321-7628-4d11-8bb8-a1167ca04be6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.208925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:55.266666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.267277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.267553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.267824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.268496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.270091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72f21-94ac-4c6b-b583-34871cce77ea admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.281407 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 925/1861] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:41:55.285530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.296443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3054f-b469-44b3-bd4a-132d6a954565 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.301017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.301661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.301933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.302202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] PATH_INFO: `/v3/projects/a7e84de6fa9f4beda775793acaf92b5e/users/af09cc47d0ed43f6be0239d647df97e4/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.304132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e84de6fa9f4beda775793acaf92b5e, user_id=af09cc47d0ed43f6be0239d647df97e4, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.306740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.317258 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 937/1862] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:41:55 2022] PUT /identity/v3/projects/a7e84de6fa9f4beda775793acaf92b5e/users/af09cc47d0ed43f6be0239d647df97e4/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:41:55.328717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973977-a90c-4759-b2dd-f1f7e1756312 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.329030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973977-a90c-4759-b2dd-f1f7e1756312 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.329422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973977-a90c-4759-b2dd-f1f7e1756312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.361248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7f973977-a90c-4759-b2dd-f1f7e1756312 None None] MFA Rules not processed for user `af09cc47d0ed43f6be0239d647df97e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:55.362471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7f973977-a90c-4759-b2dd-f1f7e1756312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:55.432667 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 926/1863] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:55.445818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:55.447733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:55.458101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:55.511974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafd24-224c-4099-a033-53d5128ee1ac admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:55.519533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:55.520171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.520446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.520713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.524479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:55.524764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:55.525035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:55.544467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] MFA Rules not processed for user `5628a861c90042d88b95f2d7b898ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:55.545665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:55.580395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:55.581839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:55.590746 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 938/1864] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:55.601955 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 927/1865] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:41:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:56.977554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:56.979055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:56.990641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f0b5-f0d8-4903-aefe-b28f4c00a268 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:56.994418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:56.995071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:56.995294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:56.995568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:57.005171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:57.006618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d995f-98ea-42fc-bb11-3b23f7bdfb6a service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:57.016341 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 939/1866] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:00.907282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:00.951159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:00.979764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87ab94-6eeb-420e-a7e0-912aea061d49 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:00.984296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:00.984993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:00.985271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:00.985540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] PATH_INFO: `/v3/users/13539f75fd5e425aba76c4f3b12bd351` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:00.987006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13539f75fd5e425aba76c4f3b12bd351)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:00.988984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:01.046015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13539f75fd5e425aba76c4f3b12bd351'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.046555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13539f75fd5e425aba76c4f3b12bd351'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.056534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13539f75fd5e425aba76c4f3b12bd351'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.070867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13539f75fd5e425aba76c4f3b12bd351'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.071697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13539f75fd5e425aba76c4f3b12bd351'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.087888 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 928/1867] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:00 2022] DELETE /identity/v3/users/13539f75fd5e425aba76c4f3b12bd351 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:01.091189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:01.091649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:01.091762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.116683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:01.118184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:01.185922 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 940/1868] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:01.198709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:01.200175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:01.277054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616f18-122d-4fb3-bb14-a58753806be7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:01.281310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:01.281979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:01.282322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:01.282596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.292709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:01.294256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:01.305758 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 929/1869] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:01.605957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:01.612147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:01.642702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a69aa-5e99-4a7b-906e-b896b3d6c9b1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:01.648756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:01.649476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:01.649841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:01.650277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] PATH_INFO: `/v3/projects/24bd7aae3494499090b08b1dff6b6f8b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.651617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bd7aae3494499090b08b1dff6b6f8b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:01.654137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:01.701589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:01.705857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bd7aae3494499090b08b1dff6b6f8b', 'request_id': 'req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.712981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bd7aae3494499090b08b1dff6b6f8b', 'request_id': 'req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.719418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bd7aae3494499090b08b1dff6b6f8b', 'request_id': 'req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.733050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] The token cache is being invalidate because project 24bd7aae3494499090b08b1dff6b6f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:01.733334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.733958 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.735443 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 941/1870] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:01 2022] DELETE /identity/v3/projects/24bd7aae3494499090b08b1dff6b6f8b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:01.739938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:01.749503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806af2e-48f6-4471-b469-b5f83d6a9fcc service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:01.810173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:01.819209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:01.819892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:01.820942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:01.821431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] PATH_INFO: `/v3/users/af09cc47d0ed43f6be0239d647df97e4` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.823018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af09cc47d0ed43f6be0239d647df97e4)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:01.825516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:01.882526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af09cc47d0ed43f6be0239d647df97e4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.883249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af09cc47d0ed43f6be0239d647df97e4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.890791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af09cc47d0ed43f6be0239d647df97e4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.908476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af09cc47d0ed43f6be0239d647df97e4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.909206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c3a603cb-d9d4-4b84-97ec-bcdee7e50f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af09cc47d0ed43f6be0239d647df97e4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:01.921351 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 930/1871] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:01 2022] DELETE /identity/v3/users/af09cc47d0ed43f6be0239d647df97e4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:02.203275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.204761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:02.217889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50ae1b-40c3-4bc5-93b1-402dfe286e18 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.281699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.282385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.282666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.283088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] PATH_INFO: `/v3/projects/a7e84de6fa9f4beda775793acaf92b5e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.284329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e84de6fa9f4beda775793acaf92b5e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.286355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.342921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e84de6fa9f4beda775793acaf92b5e', 'request_id': 'req-a89f65e4-3d86-4364-9279-c33e6c20dec2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:02.349073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e84de6fa9f4beda775793acaf92b5e', 'request_id': 'req-a89f65e4-3d86-4364-9279-c33e6c20dec2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:02.355700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e84de6fa9f4beda775793acaf92b5e', 'request_id': 'req-a89f65e4-3d86-4364-9279-c33e6c20dec2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:02.369986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] The token cache is being invalidate because project a7e84de6fa9f4beda775793acaf92b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:02.370166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:02.372408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a89f65e4-3d86-4364-9279-c33e6c20dec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:02.374411 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 942/1872] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:02 2022] DELETE /identity/v3/projects/a7e84de6fa9f4beda775793acaf92b5e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:02.380319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.380759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.381105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.401672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:02.403130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:02.498093 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 931/1873] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:02.509337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.509617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.509887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.530596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:02.531864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:02.541154 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 943/1874] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:02.545422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.556675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5957-20d5-41fd-ac22-3c07c009e3f4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.561231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.561824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.562095 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.562367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.563000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:42:02.563296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.565462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.576571 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 932/1875] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:42:02.581332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.590476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbcf49-4d50-4330-92e0-f2ac5416ea92 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.595028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.596238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.596446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.596716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.597340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.599243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.630465 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 944/1876] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:42:02.634659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.644591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4d44-793d-444f-8f94-ffb10a069a6f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.703185 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.703788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.704093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.704363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.705276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.707361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.717164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:02.735162 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 933/1877] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:02.735704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.747301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275269a-0d9f-4eae-adfc-76a737b52d5a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.752440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.753036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.753316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.753584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.754222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.755814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.765963 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 945/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:42:02.770200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.780610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0228-da7f-48d4-81ce-a793d1d5621c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.785869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.786411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.786688 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.786957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.787602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.789277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb225fa-a4f0-4142-88da-7bd721c4edfc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.800786 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 934/1879] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:02.804932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.815083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7cd32-63b9-4e7c-93d0-80330a08a2cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.819754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.820566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.820881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.821188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] PATH_INFO: `/v3/projects/b7abefab3a964e5bb6686e5f4ef991c2/users/1a5a2b420d4e45faaedafebd668c8998/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.837296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7abefab3a964e5bb6686e5f4ef991c2, user_id=1a5a2b420d4e45faaedafebd668c8998, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.839980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:02.848268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:02.853890 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 946/1880] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:02 2022] PUT /identity/v3/projects/b7abefab3a964e5bb6686e5f4ef991c2/users/1a5a2b420d4e45faaedafebd668c8998/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:02.865464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.865754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.866033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.895010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] MFA Rules not processed for user `1a5a2b420d4e45faaedafebd668c8998`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:02.896282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:02.962819 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 935/1881] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:02.967364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.030463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191a37-3f6e-4dda-8a32-8c42487c13aa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.036748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.037397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.037680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.037955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.038611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.040585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.067598 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 947/1882] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:03.071790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.084114 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249268a-1e01-48c6-bd50-4d3b51e4bd04 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.141954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.143131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.143408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.143732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.144396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.146445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.171862 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 936/1883] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:03 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:03.177107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.190321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68bf2-7ba4-4607-a287-bc64588140f6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.195538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.196177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.196452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.196719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.197357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.198944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.214738 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 948/1884] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:03.218280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.230477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b034dfb-9e86-4b98-834b-a43b2f6448d5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.235272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.236279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.236560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.236834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] PATH_INFO: `/v3/projects/7ef6a5786ea545e89f195b2fc6651eea/users/12243e2d25f04014a7f1e067f5432a8f/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.253368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef6a5786ea545e89f195b2fc6651eea, user_id=12243e2d25f04014a7f1e067f5432a8f, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.256409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.270468 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 937/1885] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:03 2022] PUT /identity/v3/projects/7ef6a5786ea545e89f195b2fc6651eea/users/12243e2d25f04014a7f1e067f5432a8f/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:03.274633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.284628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec538d9-a061-4992-957b-82c97d0dcbca admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.346843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.347363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.347639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.347942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.348586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.350247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b694a0-0fb4-41ad-b0ef-212af86d1d82 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.360439 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 949/1886] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:03.364839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.374968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24136b-8b5d-49c1-a82f-9096103443c6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.380477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.381329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.381715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.381990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] PATH_INFO: `/v3/projects/7ef6a5786ea545e89f195b2fc6651eea/users/12243e2d25f04014a7f1e067f5432a8f/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.384196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef6a5786ea545e89f195b2fc6651eea, user_id=12243e2d25f04014a7f1e067f5432a8f, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.386882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.398188 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 938/1887] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:03 2022] PUT /identity/v3/projects/7ef6a5786ea545e89f195b2fc6651eea/users/12243e2d25f04014a7f1e067f5432a8f/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:03.408422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.408699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.408972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.437300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] MFA Rules not processed for user `12243e2d25f04014a7f1e067f5432a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:03.438505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:03.507237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:03.522879 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 950/1888] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:03.535105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.544159 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:03.577593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:03.619148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e8d20-cb38-459f-bb4a-4b1fb425149f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.623654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.624292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.624565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.624832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.639161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.640750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.652156 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 939/1889] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:03.728484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:03.738607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19bca-e6b6-4eb8-8b79-07aca66c1138 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:03.742046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:03.742632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:03.742903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:03.743167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:03.800614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:03.802049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235092e-8c3c-4cd8-89a1-c0f33c4d4468 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.810789 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 951/1890] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:07.936419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:08.009030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144b68-ceaf-4953-af5d-160445d1b091 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:08.013500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:08.014123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.014736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.015482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] PATH_INFO: `/v3/users/1a5a2b420d4e45faaedafebd668c8998` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.016204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5a2b420d4e45faaedafebd668c8998)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:08.018128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:08.078495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5a2b420d4e45faaedafebd668c8998'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.079262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5a2b420d4e45faaedafebd668c8998'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.088703 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5a2b420d4e45faaedafebd668c8998'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.101529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5a2b420d4e45faaedafebd668c8998'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.102188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5a2b420d4e45faaedafebd668c8998'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.115185 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 940/1891] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:07 2022] DELETE /identity/v3/users/1a5a2b420d4e45faaedafebd668c8998 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:08.119617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.120127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.120220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.141158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:08.142401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:08.202480 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 952/1892] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:08.212405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:08.214626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:08.282778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:08.290874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ad24-3f4f-4fc9-8f3c-1f9169c9b187 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:08.302637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:08.304605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.308555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.308555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.324245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:08.325706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:08.343764 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 941/1893] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:42:08.689116 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:08.691178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:08.703286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371fb72-b9c4-4270-a655-2b315bca7b99 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:08.712082 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:08.712912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.713326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.713612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] PATH_INFO: `/v3/projects/b7abefab3a964e5bb6686e5f4ef991c2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.715981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7abefab3a964e5bb6686e5f4ef991c2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:08.720135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:08.777338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7abefab3a964e5bb6686e5f4ef991c2', 'request_id': 'req-e6f075f3-78d7-4335-8b28-0215342b3f22'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.782892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7abefab3a964e5bb6686e5f4ef991c2', 'request_id': 'req-e6f075f3-78d7-4335-8b28-0215342b3f22'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.790903 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7abefab3a964e5bb6686e5f4ef991c2', 'request_id': 'req-e6f075f3-78d7-4335-8b28-0215342b3f22'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.805810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] The token cache is being invalidate because project b7abefab3a964e5bb6686e5f4ef991c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:08.806100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.806729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.808382 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 953/1894] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:08 2022] DELETE /identity/v3/projects/b7abefab3a964e5bb6686e5f4ef991c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:08.812697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:08.824828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2cfae-d96d-42d1-94bd-063f60f405b8 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:08.883279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:08.883940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.884219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.884487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] PATH_INFO: `/v3/users/12243e2d25f04014a7f1e067f5432a8f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.885637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12243e2d25f04014a7f1e067f5432a8f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:08.887567 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:08.936362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12243e2d25f04014a7f1e067f5432a8f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.937073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12243e2d25f04014a7f1e067f5432a8f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.944445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12243e2d25f04014a7f1e067f5432a8f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.957075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12243e2d25f04014a7f1e067f5432a8f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.957450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-89e26e10-be4e-4f8a-b99d-8edf0f49076b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12243e2d25f04014a7f1e067f5432a8f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:08.973187 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 942/1895] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:08 2022] DELETE /identity/v3/users/12243e2d25f04014a7f1e067f5432a8f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:09.244320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.245902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:09.261841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f075f3-78d7-4335-8b28-0215342b3f22 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.276429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:09.324470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.325099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.325376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.325649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] PATH_INFO: `/v3/projects/7ef6a5786ea545e89f195b2fc6651eea` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.326785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef6a5786ea545e89f195b2fc6651eea)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.328880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.379991 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef6a5786ea545e89f195b2fc6651eea', 'request_id': 'req-a4fc816e-f230-47e6-b02b-278b651406f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:09.385564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef6a5786ea545e89f195b2fc6651eea', 'request_id': 'req-a4fc816e-f230-47e6-b02b-278b651406f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:09.391902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef6a5786ea545e89f195b2fc6651eea', 'request_id': 'req-a4fc816e-f230-47e6-b02b-278b651406f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:09.404472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] The token cache is being invalidate because project 7ef6a5786ea545e89f195b2fc6651eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:09.404754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:09.405386 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a4fc816e-f230-47e6-b02b-278b651406f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:09.406848 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 954/1896] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:09 2022] DELETE /identity/v3/projects/7ef6a5786ea545e89f195b2fc6651eea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:09.411774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.412093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.412367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.433350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:09.434649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:09.499480 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 943/1897] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:09.507434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.507816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.508128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.531154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:09.532396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:09.540872 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 955/1898] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:09.545055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.555215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056dd3c-1c4a-4fbb-814b-36c68fd2b0e0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.559820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.560476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.560754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.561025 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.562059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:42:09.562059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.563583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.566959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:09.579052 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 944/1899] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:42:09.587942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.597420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e9917-eafa-43e6-a2fa-4a2926a5671f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.602052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.602730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.603073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.603411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.604142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.606155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.636952 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 956/1900] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:09.641161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.651084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e8c32-9827-4501-8e59-4ac235513e6e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.711571 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.712212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.712487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.712752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.713391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.715284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.736463 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 945/1901] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:09.741404 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.751659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a85ad-469d-4c07-846c-d71aaa333072 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.756300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.756890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.757176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.757447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.758094 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.760147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.771019 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 957/1902] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:09.775478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.786174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0406ea-d59d-4eb1-9028-6b983e64c406 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.790686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.791269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.791548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.791818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.792483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.794080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8560-055e-4f17-a35f-cc6d017dd982 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.804778 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 946/1903] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:09.808867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:09.819659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b773-6477-4e80-a01f-f9ec53bc15f0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:09.824332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:09.824977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.825253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.825523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] PATH_INFO: `/v3/projects/9c79e611d81148218d0d2c5c140a5f48/users/965064ec38b34763a3e6a0deba0cdc0b/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.840928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c79e611d81148218d0d2c5c140a5f48, user_id=965064ec38b34763a3e6a0deba0cdc0b, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:09.843759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:09.859278 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 958/1904] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:09 2022] PUT /identity/v3/projects/9c79e611d81148218d0d2c5c140a5f48/users/965064ec38b34763a3e6a0deba0cdc0b/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:09.870599 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:09.870885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:09.871158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:09.900619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] MFA Rules not processed for user `965064ec38b34763a3e6a0deba0cdc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:09.901818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:09.970505 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 947/1905] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:09.975992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.022345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:10.042884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a78f6-12b5-47ea-adc0-9cb42adc126e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.047590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.048239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.048519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.048789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.049415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.051572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.078312 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 959/1906] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:09 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:42:10.083324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.094376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8886-ace8-4e9a-b3ac-4863b8d6320a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.152118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.152756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.153035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.153313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.153960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.155947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.165944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:10.177443 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 948/1907] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:10 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:10.181418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.192712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b193c-dbf1-477c-87ff-ca364ae50d45 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.197579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.198211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.198498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.198752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.199416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.201047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.213105 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 960/1908] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:10.217478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.227395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443481-2219-45b2-9e94-11ed368c206b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.231938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.232572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.232847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.233118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] PATH_INFO: `/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d/users/32a800e1bde64dfb98a28fd13af688b7/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.247799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4b5b5f883e46598d61fd4ae8d6f44d, user_id=32a800e1bde64dfb98a28fd13af688b7, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.250470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.263752 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 949/1909] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:10 2022] PUT /identity/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d/users/32a800e1bde64dfb98a28fd13af688b7/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:10.267651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.279048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bfb8a-d9b3-4a0e-857e-aff759f3a626 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.336945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.337817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.338172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.338535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.339254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.340900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb0957-d71e-4819-931a-58686aade0f3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.351140 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 961/1910] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:42:10.355421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.366457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43a07-4073-4097-91a2-e28db1d3868d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.371038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.371672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.371973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.372251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] PATH_INFO: `/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d/users/32a800e1bde64dfb98a28fd13af688b7/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.374105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4b5b5f883e46598d61fd4ae8d6f44d, user_id=32a800e1bde64dfb98a28fd13af688b7, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.376747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.387383 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 950/1911] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:10 2022] PUT /identity/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d/users/32a800e1bde64dfb98a28fd13af688b7/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:10.398677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.399056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.399342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.429265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] MFA Rules not processed for user `32a800e1bde64dfb98a28fd13af688b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:10.430500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:10.500459 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 962/1912] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:10.511929 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.513650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:10.573856 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540540-08c5-4616-9e8a-debaf0c88d91 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.577301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.577906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.578186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.578457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.588387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.589818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.599811 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 951/1913] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:10.705669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:10.717698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109e5d-b534-43b3-9fb1-78a7ccc138e5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:10.723015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:10.723627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:10.728157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:10.728617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:10.771880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:10.796680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:10.798153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1e451-b7eb-4002-a562-ba1fb2b160ea service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:10.807683 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 963/1914] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:13.423462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:13.494322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc3b91-5e16-4aa4-9b16-05f9fba8645f service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:13.500370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:13.501026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:13.501309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:13.501580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] PATH_INFO: `/v3/users/965064ec38b34763a3e6a0deba0cdc0b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:13.506738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965064ec38b34763a3e6a0deba0cdc0b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:13.508787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:13.571639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965064ec38b34763a3e6a0deba0cdc0b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:13.572373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965064ec38b34763a3e6a0deba0cdc0b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:13.581349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965064ec38b34763a3e6a0deba0cdc0b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:13.588685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:13.598720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965064ec38b34763a3e6a0deba0cdc0b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:13.599616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965064ec38b34763a3e6a0deba0cdc0b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:13.627625 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 952/1915] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:13 2022] DELETE /identity/v3/users/965064ec38b34763a3e6a0deba0cdc0b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:13.632072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:13.632578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:13.632747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:13.659499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:13.661516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:13.732300 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 964/1916] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:13.742364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:13.743960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:13.821554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d663-2dca-4547-8979-13bf519c5395 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:13.825228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:13.825764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:13.826043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:13.826307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:13.837513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:13.839121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:13.852126 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 953/1917] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:14.168195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:14.168195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:14.178019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d138f58-bb5a-42de-900d-ba7f9a4f5c60 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:14.200117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:14.200822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:14.201114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:14.201365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] PATH_INFO: `/v3/projects/9c79e611d81148218d0d2c5c140a5f48` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:14.202510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c79e611d81148218d0d2c5c140a5f48)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:14.204476 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:14.259118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c79e611d81148218d0d2c5c140a5f48', 'request_id': 'req-575173ad-28d6-4a94-9067-2a507879d822'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.265929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c79e611d81148218d0d2c5c140a5f48', 'request_id': 'req-575173ad-28d6-4a94-9067-2a507879d822'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.274546 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c79e611d81148218d0d2c5c140a5f48', 'request_id': 'req-575173ad-28d6-4a94-9067-2a507879d822'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.291742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] The token cache is being invalidate because project 9c79e611d81148218d0d2c5c140a5f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:14.292228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.292876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.294907 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 965/1918] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:14 2022] DELETE /identity/v3/projects/9c79e611d81148218d0d2c5c140a5f48 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:14.298594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:14.309103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ac78-d877-43b5-8cde-b2e29bef8353 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:14.371254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:14.371976 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:14.372263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:14.372535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] PATH_INFO: `/v3/users/32a800e1bde64dfb98a28fd13af688b7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:14.373652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a800e1bde64dfb98a28fd13af688b7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:14.375596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:14.422397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a800e1bde64dfb98a28fd13af688b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.423190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a800e1bde64dfb98a28fd13af688b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.431171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a800e1bde64dfb98a28fd13af688b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.444574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a800e1bde64dfb98a28fd13af688b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.445379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-745d818f-2de4-4e34-a9db-e5a1685cb5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a800e1bde64dfb98a28fd13af688b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.454088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:14.460255 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 954/1919] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:14 2022] DELETE /identity/v3/users/32a800e1bde64dfb98a28fd13af688b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:14.735414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:14.737088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:14.750400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575173ad-28d6-4a94-9067-2a507879d822 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:14.809701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:14.810324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:14.810598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:14.810866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] PATH_INFO: `/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:14.811998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4b5b5f883e46598d61fd4ae8d6f44d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:14.813914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:14.815298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:14.862529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4b5b5f883e46598d61fd4ae8d6f44d', 'request_id': 'req-8207cf60-9117-4252-915c-ec5932333a47'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.869045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4b5b5f883e46598d61fd4ae8d6f44d', 'request_id': 'req-8207cf60-9117-4252-915c-ec5932333a47'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.875507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4b5b5f883e46598d61fd4ae8d6f44d', 'request_id': 'req-8207cf60-9117-4252-915c-ec5932333a47'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.890136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] The token cache is being invalidate because project 1f4b5b5f883e46598d61fd4ae8d6f44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:14.890422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.891034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207cf60-9117-4252-915c-ec5932333a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:14.892653 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 966/1920] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:14 2022] DELETE /identity/v3/projects/1f4b5b5f883e46598d61fd4ae8d6f44d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:14.898483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:14.898908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:14.899246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:14.919194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:14.920400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:14.979799 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 955/1921] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:14.988139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:14.989015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:14.989287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.009450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:15.010631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:15.018702 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 967/1922] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:42:15.022970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.032430 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d961-f3c3-48f9-aa62-ba1509ee4fc2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.037449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.038144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.038511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.038873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.039602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:42:15.040064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.041871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.053681 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 956/1923] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:42:15.057855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.067485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b0057-53cb-4af4-8a54-23ad405b46b5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.072265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.072842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.073114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.073379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.074002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.075907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.102610 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 968/1924] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:15.106862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.117534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73ffa7-3036-4bca-a2e7-3f26582b6922 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.171622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.172251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.172531 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.172852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.173487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.175400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.202873 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 957/1925] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:15.204095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.214808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3459e4-874a-4d8d-99ef-7032b28813b7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.219425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.220037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.220311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.220604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.221215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.223310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.233980 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 969/1926] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:42:15.238091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.248993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26abc7-b911-4c1f-85ca-aed58455cf9a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.253457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.254089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.254361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.254682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.255259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.256885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351984d-f1ca-4437-8850-24f2886568e5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.267187 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 958/1927] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:15.271972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.281738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f4f4-6805-4735-9804-cc424b7bbceb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.287299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.287952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.288228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.288495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] PATH_INFO: `/v3/projects/e86f58ccfaa541d1997f5559033cd2b2/users/b83caa6e2b144a6c87f9c6b091301740/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.304120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86f58ccfaa541d1997f5559033cd2b2, user_id=b83caa6e2b144a6c87f9c6b091301740, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.306770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.319983 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 970/1928] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:15 2022] PUT /identity/v3/projects/e86f58ccfaa541d1997f5559033cd2b2/users/b83caa6e2b144a6c87f9c6b091301740/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:15.331066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.331440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.331722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.359708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] MFA Rules not processed for user `b83caa6e2b144a6c87f9c6b091301740`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:15.360935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:15.417289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:15.427757 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 959/1929] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:15.439058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:15.440756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:15.497620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b731e-7d05-482e-bcca-b9046db1f9a0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:15.501240 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:15.501837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:15.502113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:15.502382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:15.510573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:15.512020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a919e4-b297-46aa-b3ae-62495be05233 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:15.520739 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 971/1930] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:18.085792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:18.148193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa02f-3130-4ec9-9dc0-fe71e757f3b6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:18.152694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:18.153316 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.153587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.153855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] PATH_INFO: `/v3/users/b83caa6e2b144a6c87f9c6b091301740` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.154985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83caa6e2b144a6c87f9c6b091301740)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:18.156968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:18.202169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83caa6e2b144a6c87f9c6b091301740'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.202794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83caa6e2b144a6c87f9c6b091301740'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.210045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83caa6e2b144a6c87f9c6b091301740'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.222523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83caa6e2b144a6c87f9c6b091301740'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.223150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83caa6e2b144a6c87f9c6b091301740'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.235748 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 960/1931] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:42:18 2022] DELETE /identity/v3/users/b83caa6e2b144a6c87f9c6b091301740 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:18.241024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.241493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.241584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.259997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:18.261176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:18.284636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:18.323367 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 972/1932] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:18.333535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:18.334974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:18.397244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cae38-6052-4aa1-b728-2a6eb4e3cde4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:18.400949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:18.401575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.401850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.402119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.412641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:18.414199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327c337-683e-4f35-9b27-664bca915128 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:18.425073 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 961/1933] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:18.697026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:18.698545 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:18.711962 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3ab96-c21e-4828-b576-63f26d17bdb2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:18.716944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:18.717576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.717858 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.718131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] PATH_INFO: `/v3/projects/e86f58ccfaa541d1997f5559033cd2b2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.719879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86f58ccfaa541d1997f5559033cd2b2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:18.721843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:18.770412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86f58ccfaa541d1997f5559033cd2b2', 'request_id': 'req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.777106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86f58ccfaa541d1997f5559033cd2b2', 'request_id': 'req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.783572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86f58ccfaa541d1997f5559033cd2b2', 'request_id': 'req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.796765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] The token cache is being invalidate because project e86f58ccfaa541d1997f5559033cd2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:42:18.797051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.797662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7e6a8e1b-ec75-41ec-a0aa-cd1d384831f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:42:18.799150 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 973/1934] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:42:18 2022] DELETE /identity/v3/projects/e86f58ccfaa541d1997f5559033cd2b2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:18.804045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.804329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.804603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.823627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:18.824798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:18.837407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:18.886386 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 962/1935] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:18.954313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:18.954598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:18.954889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:18.975822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:18.977150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:18.985135 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 974/1936] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:18.989655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:18.999668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf14794-e2f8-4576-91da-5bf84b479dda None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.004228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.004818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.005099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.005373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.006726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:42:19.007129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.008807 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.020475 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 963/1937] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:42:19.025203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.034360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3f54-2587-4d18-ad12-0b6336fc2c41 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.039150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.039743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.040051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.040324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.040968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.042861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.071430 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 975/1938] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:19 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:19.075720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.086238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b93a-6461-4f4a-b3d3-393c24bdf8d0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.141401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.141993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.142271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.142551 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.143183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.145128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.166723 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 964/1939] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:19 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:19.170758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.181391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76430-113d-4bbc-8e25-af9ee293421c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.186308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.186909 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.187190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.187471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.188170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.189794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.200443 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 976/1940] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:19.204447 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.215033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6bf4d-d77a-4097-83df-d846055f53ac admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.219712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.220371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.220670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.220945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.221583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.223204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580d9d-ecc1-4a1d-9cdf-5e783eba25c5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.234055 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 965/1941] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:19.238273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.248603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6af12-f7d9-4ecd-a0e5-907a4b9a9412 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.253466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.254104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.254381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.254653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] PATH_INFO: `/v3/projects/b8734b79aa064e5b9d04494ca7c5112b/users/53358104a2534d9084e19ca4ae59816e/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.269868 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8734b79aa064e5b9d04494ca7c5112b, user_id=53358104a2534d9084e19ca4ae59816e, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.273218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.285849 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 977/1942] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:19 2022] PUT /identity/v3/projects/b8734b79aa064e5b9d04494ca7c5112b/users/53358104a2534d9084e19ca4ae59816e/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:19.291072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b65-a3a6-4fbb-bf55-16c27b8e3629 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.291358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b65-a3a6-4fbb-bf55-16c27b8e3629 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.291632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b65-a3a6-4fbb-bf55-16c27b8e3629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.310706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ae346b65-a3a6-4fbb-bf55-16c27b8e3629 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:19.311972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ae346b65-a3a6-4fbb-bf55-16c27b8e3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:19.371057 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 966/1943] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:19.381490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.383186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:19.437433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:19.441758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473173-c43d-4e03-9c24-c6b5178a2d2b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.446627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.447226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.447499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.447766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.458796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.460549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.470665 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 978/1944] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:23.524693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:23.525187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:23.525265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:23.556389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] MFA Rules not processed for user `53358104a2534d9084e19ca4ae59816e`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:23.557617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:23.570553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:23.629176 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 967/1945] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:23.634783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:23.644813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be0fa-5edc-40fa-8d35-9601a7cde7ab service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:23.651038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:23.651879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:23.652200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:23.652473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:23.653128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:23.655069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:23.685822 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 979/1946] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:42:23 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:23.689845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:23.702103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fea79-7d48-4bfc-8000-f41c5925a38c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:23.773276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:23.774278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:23.774765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:23.775370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:23.776155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:23.778480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:23.835954 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 968/1947] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:42:23 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:42:23.837503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:23.854393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72368a82-2041-4cea-85cb-3c6aea837fa9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:23.867683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:23.868749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:23.869127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:23.869501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:23.870338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:23.872503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:23.891222 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 980/1948] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:42:23.895402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:23.906215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbaead-cb94-4f6c-b25b-3664765e2f11 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:23.911296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:23.912148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:23.913055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:23.913358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] PATH_INFO: `/v3/projects/806808391f1c41ff8e8faf005b28c8ce/users/fd3c8df4f6e947faab75a0eb4f351f77/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:23.937375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=806808391f1c41ff8e8faf005b28c8ce, user_id=fd3c8df4f6e947faab75a0eb4f351f77, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:23.940065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:23.957530 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 969/1949] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:23 2022] PUT /identity/v3/projects/806808391f1c41ff8e8faf005b28c8ce/users/fd3c8df4f6e947faab75a0eb4f351f77/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:23.961916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:23.974126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c150192-bc12-43c8-b954-f1a23739ed8a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:24.047523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:24.048089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:24.048379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:24.048628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:24.049269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:24.051126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42707925-260b-4920-96f5-24ebc24ec9ba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:24.065300 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 981/1950] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:42:24.070479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:24.089337 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eaf1d-38da-4766-b19f-09a5ccdba85a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:24.094720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:24.095804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:24.096501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:24.096779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] PATH_INFO: `/v3/projects/806808391f1c41ff8e8faf005b28c8ce/users/fd3c8df4f6e947faab75a0eb4f351f77/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:24.109840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806808391f1c41ff8e8faf005b28c8ce, user_id=fd3c8df4f6e947faab75a0eb4f351f77, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:24.113800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:24.129520 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 970/1951] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:42:24 2022] PUT /identity/v3/projects/806808391f1c41ff8e8faf005b28c8ce/users/fd3c8df4f6e947faab75a0eb4f351f77/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:42:27.314026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0597-04e8-4049-946c-f59da92c35f2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:27.315275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0597-04e8-4049-946c-f59da92c35f2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:27.316043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0597-04e8-4049-946c-f59da92c35f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:27.343231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c37e0597-04e8-4049-946c-f59da92c35f2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:27.345187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c37e0597-04e8-4049-946c-f59da92c35f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:27.473405 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 982/1952] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:27.509444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:27.511938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:27.668334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:27.679249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9212cf-3fc8-4daf-af8e-b5c5336346b4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:27.694941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:27.695816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:27.696196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:27.696457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:27.718524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:27.723152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:27.762968 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 971/1953] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:29.287679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035fb67-eba0-4a2f-aaa7-dd70c2aef566 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:29.288217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035fb67-eba0-4a2f-aaa7-dd70c2aef566 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:29.288315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035fb67-eba0-4a2f-aaa7-dd70c2aef566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:29.325831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6035fb67-eba0-4a2f-aaa7-dd70c2aef566 None None] MFA Rules not processed for user `fd3c8df4f6e947faab75a0eb4f351f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:29.327517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6035fb67-eba0-4a2f-aaa7-dd70c2aef566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:29.388332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:29.420192 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 983/1954] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:29.434619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:29.436238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:29.551390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86564db5-65c3-47a5-a4be-d2de8f4976e7 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:29.562850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:29.565583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:29.565895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:29.566171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:29.648845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:29.650541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:29.661238 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 972/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:29.845912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2e59-6d75-4226-8ddd-c99cc2710708 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:29.846270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2e59-6d75-4226-8ddd-c99cc2710708 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:29.846554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2e59-6d75-4226-8ddd-c99cc2710708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:29.892770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-afcf2e59-6d75-4226-8ddd-c99cc2710708 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:29.894675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-afcf2e59-6d75-4226-8ddd-c99cc2710708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:29.973441 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 984/1956] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:42:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:30.033598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:30.035811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:30.135648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459475b6-3618-40b8-b51b-f55d9474d372 service glance] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:30.141191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:30.141750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:30.142022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:30.142294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:30.153543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:30.155209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4ae27-eeed-44b6-ac49-8172ace4dabb service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:30.166288 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 973/1957] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:42:30.997613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:30.998173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:30.998173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:31.024540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] MFA Rules not processed for user `5f9a55c605f04f478d0a71679d8bf6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:31.026594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:31.110544 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 985/1958] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:33.730858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91a9-8415-48a3-827c-05dd5623993d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:33.731501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91a9-8415-48a3-827c-05dd5623993d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:33.731501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91a9-8415-48a3-827c-05dd5623993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:33.767764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-517d91a9-8415-48a3-827c-05dd5623993d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:33.769065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-517d91a9-8415-48a3-827c-05dd5623993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:33.781779 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 974/1959] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:33.801405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:33.823473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae004a01-f5ce-4709-84be-b8f1e3e4daf2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:33.837204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:33.838820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:33.839251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:33.839697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:33.851728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:33.854310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:33.866658 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 986/1960] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:38.195949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29160bf4-6aa5-47bd-af19-8b11c3551e54 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:38.196892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29160bf4-6aa5-47bd-af19-8b11c3551e54 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:38.197330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29160bf4-6aa5-47bd-af19-8b11c3551e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:38.232764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-29160bf4-6aa5-47bd-af19-8b11c3551e54 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:38.234278 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-29160bf4-6aa5-47bd-af19-8b11c3551e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:38.244206 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 975/1961] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:38.267326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:38.285186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed51cc-e598-4de7-8e2d-bd6956684ced service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:38.295724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:38.297170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:38.297643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:38.298103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:38.310731 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:38.312735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:38.326289 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 987/1962] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:41.254072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542ead-d4c7-4eb6-b2d7-18e64bd545ca None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:41.254636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542ead-d4c7-4eb6-b2d7-18e64bd545ca None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:41.254636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542ead-d4c7-4eb6-b2d7-18e64bd545ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:41.262704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:41.275672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ae542ead-d4c7-4eb6-b2d7-18e64bd545ca None None] MFA Rules not processed for user `53358104a2534d9084e19ca4ae59816e`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:41.276912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ae542ead-d4c7-4eb6-b2d7-18e64bd545ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:41.283722 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 976/1963] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:42:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:42.468132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:42.469803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:42.569544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5afd4-1a5b-42dc-b7d1-7b1536b7fbc3 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:42.579220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:42.580059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:42.580700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:42.581026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:42.585676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:42.596135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:42.601981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:42.603649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:42.620305 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 988/1964] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:45.401203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1bd0-7295-4f06-bf45-d3d38c659a82 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:45.401712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1bd0-7295-4f06-bf45-d3d38c659a82 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:45.401819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1bd0-7295-4f06-bf45-d3d38c659a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:45.421084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c83e1bd0-7295-4f06-bf45-d3d38c659a82 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:45.422258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c83e1bd0-7295-4f06-bf45-d3d38c659a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:45.430195 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 977/1965] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:45.451460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:45.452840 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:45.468261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff257f-e289-476b-bfb6-33957df5f30c service placement] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:45.473656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:45.474466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:45.474748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:45.475018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:45.483286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:45.484880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:45.494405 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 989/1966] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:47.904277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46dc2-7672-4405-8251-cdb6f14c4bd8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:47.904761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46dc2-7672-4405-8251-cdb6f14c4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:47.904863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46dc2-7672-4405-8251-cdb6f14c4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:47.924321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-eee46dc2-7672-4405-8251-cdb6f14c4bd8 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:47.925537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eee46dc2-7672-4405-8251-cdb6f14c4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:47.934561 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 978/1967] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:42:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:47.948945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:47.960464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c16be-9737-4d4d-ad5f-c7e887a8f57e service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:47.965450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:47.966052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:47.966329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:47.966594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:47.975726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:47.988410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:47.988410 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 990/1968] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:42:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:42:57.918899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:57.990249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=15 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:04.128731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2475ea-378f-4f24-9b4a-d3a5d8e1395a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:04.129314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2475ea-378f-4f24-9b4a-d3a5d8e1395a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:04.129314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2475ea-378f-4f24-9b4a-d3a5d8e1395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:04.161228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2d2475ea-378f-4f24-9b4a-d3a5d8e1395a None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:04.162570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2d2475ea-378f-4f24-9b4a-d3a5d8e1395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:04.172094 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 979/1969] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:04.186170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:04.199262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066499e6-aaf0-49aa-a7d6-1ae57fd667fc service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:04.204726 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:04.205411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:04.205766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:04.206137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:04.215710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:04.217588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:04.227379 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 991/1970] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:43:06.162827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b84a-d2f3-4513-8c58-7a246da754f9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:06.164791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b84a-d2f3-4513-8c58-7a246da754f9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:06.165269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b84a-d2f3-4513-8c58-7a246da754f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:06.207587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-35f3b84a-d2f3-4513-8c58-7a246da754f9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:06.212320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-35f3b84a-d2f3-4513-8c58-7a246da754f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:06.224350 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 980/1971] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:06.248943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:06.263979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9abba2-4d3e-4705-9f42-5e8fa7924974 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:06.271142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:06.271762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:06.272139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:06.273432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:06.292702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:06.294735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:06.307021 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 992/1972] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:11.464304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858a855-aad7-4806-9a64-1dc378367d69 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:11.465338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858a855-aad7-4806-9a64-1dc378367d69 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:11.465608 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858a855-aad7-4806-9a64-1dc378367d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:11.493718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6858a855-aad7-4806-9a64-1dc378367d69 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:11.495128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6858a855-aad7-4806-9a64-1dc378367d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:11.504516 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 981/1973] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:11.528725 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:11.541014 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7185b-6d1d-4b41-88d8-516939c73f22 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:11.547143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:11.547936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:11.548219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:11.548495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:11.557559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:11.559288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856f4b-c0e2-45f0-bc27-245928afb977 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:11.570169 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 993/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:21.486262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=9 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:21.564685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=18 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:27.253443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627b93-60a3-44ab-a746-1a009ddeadc2 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.253981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627b93-60a3-44ab-a746-1a009ddeadc2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.253981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627b93-60a3-44ab-a746-1a009ddeadc2 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.255322 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 982/1975] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:27.262288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c681a-ebe7-4a24-bc45-35eba638f635 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.262762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c681a-ebe7-4a24-bc45-35eba638f635 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.262867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c681a-ebe7-4a24-bc45-35eba638f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.282574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-491c681a-ebe7-4a24-bc45-35eba638f635 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:27.283835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-491c681a-ebe7-4a24-bc45-35eba638f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:27.294070 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 994/1976] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:27.306495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6627b93-60a3-44ab-a746-1a009ddeadc2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:27.317330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6627b93-60a3-44ab-a746-1a009ddeadc2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:27.322008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:27.322686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.323045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.323340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.333876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:27.335466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1170-f210-40c9-b4ba-5739890bce01 service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:27.347011 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 983/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:27.456584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4e28-cbdd-4702-ad61-0bc869293ced None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.456861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4e28-cbdd-4702-ad61-0bc869293ced None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.457750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4e28-cbdd-4702-ad61-0bc869293ced None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.459728 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 995/1978] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:27.465715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f0ff-8ad0-4b40-9c8e-0582620d987e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.465998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f0ff-8ad0-4b40-9c8e-0582620d987e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.466273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f0ff-8ad0-4b40-9c8e-0582620d987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.492231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6bd8f0ff-8ad0-4b40-9c8e-0582620d987e None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:27.493780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bd8f0ff-8ad0-4b40-9c8e-0582620d987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:27.555544 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 984/1979] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:27.567749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4e28-cbdd-4702-ad61-0bc869293ced None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:27.580287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4e28-cbdd-4702-ad61-0bc869293ced None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:27.583764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:27.584388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.584670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.584967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.596882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:27.598971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab313-86fe-4daf-9f7f-ee6b67a360ac service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:27.615594 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 996/1980] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:27.702953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783948-0e52-4938-9609-61d0ddd2b2fc None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.703240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783948-0e52-4938-9609-61d0ddd2b2fc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.703516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783948-0e52-4938-9609-61d0ddd2b2fc None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.704911 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 985/1981] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:43:27.710202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.711049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.711347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.730986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:27.732206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:27.742864 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 997/1982] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:27.753301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783948-0e52-4938-9609-61d0ddd2b2fc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:27.764784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783948-0e52-4938-9609-61d0ddd2b2fc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:27.768347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:27.768932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:27.769209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:27.769476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:27.780528 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:27.781995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cc454-2172-4334-ab63-37c687f37881 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:27.792745 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 986/1983] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:28.631598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:28.633682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:28.644925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71f05b-6612-4044-803d-08da4ada44b5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:28.649675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:28.650314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:28.650595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:28.650869 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:28.660414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:28.662185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:28.674057 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 998/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:32.229830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c263-3653-4267-ae49-887201b27c7c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:32.230315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c263-3653-4267-ae49-887201b27c7c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:32.230315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c263-3653-4267-ae49-887201b27c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:32.250940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8dd3c263-3653-4267-ae49-887201b27c7c None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:32.252456 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8dd3c263-3653-4267-ae49-887201b27c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:32.271385 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 987/1985] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:32.286146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:32.300069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d578-7139-41e5-8d9c-281e02368226 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:32.308072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:32.308956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:32.309233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:32.309504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:32.321249 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:32.322978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4906c-1800-4d67-b986-056e0e8fb26d service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:32.332807 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 999/1986] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:43:33.703105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:33.703576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:33.703694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:33.722683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] MFA Rules not processed for user `bb1e83f51a384b7d9d044bce87f00990`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:33.723901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:33.797558 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 988/1987] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:43:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.329117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=24 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.791338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=63 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:00.668208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2b72-d87e-40fd-ad83-4953c0131222 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:00.668700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2b72-d87e-40fd-ad83-4953c0131222 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:00.668809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2b72-d87e-40fd-ad83-4953c0131222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:00.688569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d2ea2b72-d87e-40fd-ad83-4953c0131222 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:00.689743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2ea2b72-d87e-40fd-ad83-4953c0131222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:00.696853 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1000/1988] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:44:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:00.710466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:00.722126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e755db-7e35-40d5-a608-d1214a80c325 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:00.727039 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:00.727629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:00.727940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:00.728213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:00.738139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:00.740013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:00.748634 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 989/1989] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:44:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:10.683231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:10.744697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:12.489416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ebb66-8a9d-4217-a1d2-e5aebe89a0b1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.489995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ebb66-8a9d-4217-a1d2-e5aebe89a0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.489995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ebb66-8a9d-4217-a1d2-e5aebe89a0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.509157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-950ebb66-8a9d-4217-a1d2-e5aebe89a0b1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:12.510369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-950ebb66-8a9d-4217-a1d2-e5aebe89a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.518821 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1001/1990] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:12.544547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.556196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19331-db8f-4ff0-9357-5ad7ae1c82d2 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.561536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.562124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.562401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.562671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.570689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.572294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.582144 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 990/1991] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:16.796548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e88d-22ed-40ee-a756-ffe21704cdfa None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.797103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e88d-22ed-40ee-a756-ffe21704cdfa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.797809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e88d-22ed-40ee-a756-ffe21704cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.817683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0751e88d-22ed-40ee-a756-ffe21704cdfa None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:16.818883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0751e88d-22ed-40ee-a756-ffe21704cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:16.826700 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1002/1992] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:16.847308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.858647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4bd3-cf29-4939-b4d1-99a1559e3c65 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.865346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.865927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.866201 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.866467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.874449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.877227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdb9a-cb1d-4515-8d92-c106e8a05c6d service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.886498 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 991/1993] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:21.251017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.251555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.251661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.270648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] MFA Rules not processed for user `5628a861c90042d88b95f2d7b898ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:21.271837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.324724 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1003/1994] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:44:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:21.943309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e579b-ea43-4b84-9c6a-02d4d2ec5db3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.943906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e579b-ea43-4b84-9c6a-02d4d2ec5db3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.944033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e579b-ea43-4b84-9c6a-02d4d2ec5db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.963939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fc2e579b-ea43-4b84-9c6a-02d4d2ec5db3 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:21.965141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fc2e579b-ea43-4b84-9c6a-02d4d2ec5db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.973117 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 992/1995] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:21.998447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:22.012513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af53607-16e6-4dc5-b1a2-3f33ecaa0bd6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:22.019092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:22.019704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.020114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.020314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.029352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:22.030922 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:22.040922 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1004/1996] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:28.182442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a0a6-b467-4a58-aed1-0286767c86eb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:28.182979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a0a6-b467-4a58-aed1-0286767c86eb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:28.182979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a0a6-b467-4a58-aed1-0286767c86eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:28.207451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f594a0a6-b467-4a58-aed1-0286767c86eb None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:28.208706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f594a0a6-b467-4a58-aed1-0286767c86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:28.217092 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 993/1997] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:28.239579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:28.251648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef65e-4321-47a4-b6d8-d965694d890e service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:28.257189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:28.257782 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:28.258057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:28.258324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:28.266864 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:28.269003 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:28.278628 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1005/1998] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:32.365823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:32.366320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:32.366434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:32.386332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:32.387523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:32.396315 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 994/1999] 10.222.0.18 () {58 vars in 1016 bytes} [Wed Oct 19 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:32.422656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:32.433853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b1f4-63f1-4275-a53a-24cba485e1be service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:32.439332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:32.439994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:32.440793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:32.441067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:32.449258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:32.450817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:32.461005 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1006/2000] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:38.978761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:38.989596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665ac9c-237a-4869-b98c-deefa55c79b9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:38.993074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:38.993665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:38.993935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:38.994202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:38.995914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.009344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:39.010748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:39.021893 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 995/2001] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:40.196460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.205610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ad99-db60-4545-8248-ba11007aaad7 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.209222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.209801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.210077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.210347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.212078 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:40.225032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.226466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.237081 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1007/2002] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:49.016998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=27 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:50.232360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=55 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:54.501998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.503377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.559354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33960b93-aefc-49ff-a4d1-60568f0f1394 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.563039 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.563660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.563960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.564229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.565927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.577013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.578475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:54.587614 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 996/2003] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:54.594227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.606618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04f1e-1323-459f-b3e6-e82614eb2363 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.612411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.613097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.613437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.614780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.624178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.625810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc65f-19b0-498a-8de6-8e04e0090475 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:54.635407 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1008/2004] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:54.972622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.982636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc232-f7d3-4825-aedd-3865a36c81a0 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.986221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.986818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.987100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.987376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.990045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:55.052526 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.053971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.062899 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 997/2005] 10.222.0.33 () {60 vars in 1396 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:03.069061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:03.069643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:03.069643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:03.088570 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] MFA Rules not processed for user `5f9a55c605f04f478d0a71679d8bf6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:03.089843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.096693 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1009/2006] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:03.420162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:03.429509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc261-cea1-48f9-b1e5-0eeda7cbafc9 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:03.435305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:03.435941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:03.436220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:03.436490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:03.438242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.461746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:03.463202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:03.472525 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 998/2007] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:03.793484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:03.794855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.810522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b52e-b778-44d2-b3d1-810d65f47440 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:03.815734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:03.817083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:03.817308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:03.817415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:03.819136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.831368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:03.833916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:03.844055 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1010/2008] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:06.182488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.191370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438493-2f9a-4cfb-a5f3-05a2abc4ac22 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.200902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.201518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.201792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.202062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.204226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:06.217950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.219458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.230083 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 999/2009] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:06.425139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.427332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:06.442224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b7bc4-d995-476b-946f-094dbcfa4e97 service placement] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.447723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.448383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.448657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.448925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] PATH_INFO: `/v3/users/bb1e83f51a384b7d9d044bce87f00990` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.450036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1e83f51a384b7d9d044bce87f00990)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.451970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.500150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1e83f51a384b7d9d044bce87f00990'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:06.501056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1e83f51a384b7d9d044bce87f00990'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:06.501656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1e83f51a384b7d9d044bce87f00990'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:06.509774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1e83f51a384b7d9d044bce87f00990'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:06.517334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93544370-c1b1-4e72-9694-39ced04ec36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1e83f51a384b7d9d044bce87f00990'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:06.535798 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1011/2010] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:06 2022] DELETE /identity/v3/users/bb1e83f51a384b7d9d044bce87f00990 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:07.160362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.179590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71551-b093-4f31-b124-855bf64e299a service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.263659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.264505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.267950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.268596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] PATH_INFO: `/v3/projects/3b24d4afc5104b359924acdf4619cfc7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.270307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b24d4afc5104b359924acdf4619cfc7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.272444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.313815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.363269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b24d4afc5104b359924acdf4619cfc7', 'request_id': 'req-3ba78852-4c38-41a5-9ef9-bd14660c68a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.373488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b24d4afc5104b359924acdf4619cfc7', 'request_id': 'req-3ba78852-4c38-41a5-9ef9-bd14660c68a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.383811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b24d4afc5104b359924acdf4619cfc7', 'request_id': 'req-3ba78852-4c38-41a5-9ef9-bd14660c68a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.398981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] The token cache is being invalidate because project 3b24d4afc5104b359924acdf4619cfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:07.399711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.406483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3ba78852-4c38-41a5-9ef9-bd14660c68a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.412991 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1000/2011] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:07 2022] DELETE /identity/v3/projects/3b24d4afc5104b359924acdf4619cfc7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:07.414208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.414503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.414781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.441128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:07.444580 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.523628 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1012/2012] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:07.532511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.532902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.533057 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.553727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:07.554994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.562805 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1001/2013] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:07.567026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.576471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182630de-306f-4cd3-8d88-4ae3b37065c8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.581316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.581964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.582238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.582505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.583143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:07.583440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.585113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.596763 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1013/2014] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:07.601607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.611439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59409c5-7c88-481b-94e1-c60759332e32 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.617825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.618465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.618982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.619298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.620217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.622192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.650800 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1002/2015] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:07 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:07.655000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.665982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccfc3c-7535-4d1c-8493-b7d934676689 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.693294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.731532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.732173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.732492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.732762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.733400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.735310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.760778 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1014/2016] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:07 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:07.762057 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.773270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb1d2-21ff-412a-af83-eaf010392afa admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.777933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.778534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.778811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.779080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.779724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.781369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.792767 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1003/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:07.796745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.807288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f117ead-1450-4007-841b-1d0d9a0a7621 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.812087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.812713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.812977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.813252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.813895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.815501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee51fc8-9659-4aa3-aa97-95fbfb454c62 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.825814 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1015/2018] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:07.829989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.840632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930b30d-15c3-44a4-a358-d4da22b63870 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.845473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.846134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.846521 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.846810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] PATH_INFO: `/v3/projects/a98f43c385ec4522b38cc84d00bef279/users/a3fe41c82b4844f8a4d38bd83206215a/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.862913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98f43c385ec4522b38cc84d00bef279, user_id=a3fe41c82b4844f8a4d38bd83206215a, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.866309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.879972 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1004/2019] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:07 2022] PUT /identity/v3/projects/a98f43c385ec4522b38cc84d00bef279/users/a3fe41c82b4844f8a4d38bd83206215a/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:07.884927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.885299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.885630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.906477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:07.907638 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.969214 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1016/2020] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:07.982933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.984661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.049797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ac122-9488-4db0-88f1-f90bf56d4a1a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.054892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.055513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.055799 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.056106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.065749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.067689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042874c-d116-48c8-9d61-7033147f0c15 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.084053 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1005/2021] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:11.935541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:11.937775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:12.086123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ade3a6-bd8d-443c-b59c-13a4152b90f5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.093435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.094065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.094345 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.094619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.099665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:12.184200 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:12.214956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.218145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.240272 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1017/2022] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:13.531974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.532470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.532583 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.566339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] MFA Rules not processed for user `a3fe41c82b4844f8a4d38bd83206215a`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:13.567570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.601740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.653681 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1006/2023] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:13.658268 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.670212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469eea0-844a-447b-b51a-f6d87d626b33 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.676237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.677055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.677394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.677728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.678479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.680750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.710056 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1018/2024] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:13.714190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.725672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b12073-874f-4b98-9f57-bf4b9a5725b3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.792361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.793174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.793658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.794013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.795081 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.797403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.825094 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1007/2025] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:13.829207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.841433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a521-3172-4c31-ad94-a9b1e58f765b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.846333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.847032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.847407 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.847824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.848519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.850195 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.862593 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1019/2026] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:13.868130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.878678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0465a-6d1a-40ee-b589-d52d458a836d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.884110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.884797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.885099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.885383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] PATH_INFO: `/v3/projects/d288d1b599de4e3b86bc5648320206e1/users/15abcc5361c54ee88373eaad447ee093/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.902222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288d1b599de4e3b86bc5648320206e1, user_id=15abcc5361c54ee88373eaad447ee093, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.905048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.919125 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1008/2027] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:13 2022] PUT /identity/v3/projects/d288d1b599de4e3b86bc5648320206e1/users/15abcc5361c54ee88373eaad447ee093/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:13.923021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.933943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4be1-7ab3-4427-9878-3dbe5e02442f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.003056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.004491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.004628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.004946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.005574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.007652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.019891 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1020/2028] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:14.023759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.039428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1f5d-e6a3-4f8b-9594-2edd39916b31 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.044222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.044888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.045244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.045525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] PATH_INFO: `/v3/projects/d288d1b599de4e3b86bc5648320206e1/users/15abcc5361c54ee88373eaad447ee093/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.047577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288d1b599de4e3b86bc5648320206e1, user_id=15abcc5361c54ee88373eaad447ee093, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.050507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1485-3b22-4861-846f-57521d653e54 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.064393 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1009/2029] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:14 2022] PUT /identity/v3/projects/d288d1b599de4e3b86bc5648320206e1/users/15abcc5361c54ee88373eaad447ee093/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:19.963772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.966576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.109790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.110281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.110478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.124664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c455f-dd4b-4fa5-86e3-9a121d01b4e0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:20.167649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] MFA Rules not processed for user `15abcc5361c54ee88373eaad447ee093`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:20.169236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.264264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:20.312664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:20.313447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.314258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.315182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.323045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.352894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:20.356070 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1010/2030] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:20.357193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:20.370367 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1021/2031] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:20.373241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:20.393613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0137-f0a3-4615-a793-f04630746646 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:20.413759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:20.414390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.414672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.414941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.428730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:20.503523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:20.506834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa7c7-8987-463e-9b04-99b30eb0f63f service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:20.526641 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1011/2032] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:21.125175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:21.140035 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0e59-e494-4d63-910a-7a099fa8ea37 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:21.148465 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:21.149691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:21.150237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:21.150676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:21.153140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:21.171978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:21.175433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f0b4-efa4-4e95-ac35-63a343d75843 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:21.193578 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1022/2033] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:22.181457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:22.182731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:22.183199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:22.245066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] MFA Rules not processed for user `a3fe41c82b4844f8a4d38bd83206215a`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:22.247164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:22.266804 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1012/2034] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:24.267654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:24.268262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:24.268262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:24.294286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] MFA Rules not processed for user `59bad833caf84817b8553d699b2fa04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:24.295894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:24.376660 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1023/2035] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:45:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:32.221751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=26 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:34.368946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=45 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:35.136110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:35.151144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa564b7-1ca0-4cc3-9547-b6e92c838f10 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:35.156740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:35.157353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:35.157632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:35.157954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:35.159726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:35.172919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:35.174519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:35.187723 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1013/2036] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:35.233294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:35.234683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:35.292073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9d240-9eed-4e30-b908-b874b20c70cd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:35.295523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:35.296219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:35.296496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:35.296764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:35.298462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:35.361627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:35.363072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:35.372551 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1024/2037] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:42.288615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:42.340635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1cdf-d125-42e4-86fb-78f13b11eb78 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:42.344301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:42.344925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:42.345179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:42.345451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:42.347223 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:42.357373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:42.358790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:42.366878 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1014/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:45.368207 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=48 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:52.364026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=32 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:58.345547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:58.357547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2327c73-ebde-4dd2-94d3-ffe710cac53b service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:58.362455 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:58.364810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:58.365255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:58.365643 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:58.375755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:58.377202 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:58.387503 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1025/2039] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:59.304893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:59.306288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:59.317300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4067-69ac-43e4-911e-1107407f091e service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:59.321353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:59.321951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.322230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.322500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.324331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:59.389718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:59.391157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:59.401516 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1015/2040] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:02.911354 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:02.912828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.927940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab920a0-756f-45c4-8dd4-e657cc498879 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:02.932447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:02.933088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:02.933363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:02.933633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] PATH_INFO: `/v3/users/5628a861c90042d88b95f2d7b898ed52` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:02.934739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5628a861c90042d88b95f2d7b898ed52)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:02.936691 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:02.982419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5628a861c90042d88b95f2d7b898ed52'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.983059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5628a861c90042d88b95f2d7b898ed52'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.983657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5628a861c90042d88b95f2d7b898ed52'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.991352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5628a861c90042d88b95f2d7b898ed52'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.998256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f7679cbd-d117-4019-a74c-9545f4c69831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5628a861c90042d88b95f2d7b898ed52'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.015440 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1026/2041] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:02 2022] DELETE /identity/v3/users/5628a861c90042d88b95f2d7b898ed52 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:03.186988 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.199413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143a0ca-a468-4fd5-a208-176902a72925 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.258783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.259404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.259677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.259984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] PATH_INFO: `/v3/projects/5a230211180742ef9efd4d62b630d211` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.261090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a230211180742ef9efd4d62b630d211)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.262981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.310094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a230211180742ef9efd4d62b630d211', 'request_id': 'req-2f024eb4-ae9b-497d-90a5-7427c3c350ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.315525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a230211180742ef9efd4d62b630d211', 'request_id': 'req-2f024eb4-ae9b-497d-90a5-7427c3c350ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.322717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a230211180742ef9efd4d62b630d211', 'request_id': 'req-2f024eb4-ae9b-497d-90a5-7427c3c350ce'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.335083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] The token cache is being invalidate because project 5a230211180742ef9efd4d62b630d211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:03.335420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.336080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f024eb4-ae9b-497d-90a5-7427c3c350ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.337618 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1016/2042] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:03 2022] DELETE /identity/v3/projects/5a230211180742ef9efd4d62b630d211 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:03.342925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.343230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.343496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.364845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:03.365951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:03.424739 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1027/2043] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:03.432750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.433037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.433713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.453296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:03.454490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:03.462689 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1017/2044] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:03.466910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.477015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb012c-7653-445b-b3dc-5f171ea4948c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.481472 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.482060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.482353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.482603 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.483237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:03.483536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.485151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.497912 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1028/2045] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:03.502047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.512514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562c11f-f655-4db7-a0e6-bbe4b91dac07 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.518115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.518744 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.519022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.519373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.519966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.521871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.538287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:03.553027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1018/2046] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:03.557232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.567197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936925f-0a4f-4978-b91f-c29321d8ae5c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.610808 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:03.629301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.629927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.630198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.630459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.631104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.633057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.654076 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1029/2047] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:03.658266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.668740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1d3a-0edb-4868-b346-fd3be8e7ebdc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.673689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.674334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.674617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.674893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.675572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.677334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.687450 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1019/2048] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:03.691983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.702068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039b76-2136-460e-ac6e-ec11ef00d49c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.707265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.707846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.708146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.708414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.709046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.710624 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc770-074a-4968-b8e4-ecd823cc5b1d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.721032 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1030/2049] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:03.725678 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.735558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d20cd-3596-45b2-b344-df6be00310ae admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.740614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.741518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.741825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.742102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] PATH_INFO: `/v3/projects/e6c7de4787bc4d1aa2bef2f59cdafdee/users/2243843372fa48b2a9a96b8073edfa8c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.757325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c7de4787bc4d1aa2bef2f59cdafdee, user_id=2243843372fa48b2a9a96b8073edfa8c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.760028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.773731 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1020/2050] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:03 2022] PUT /identity/v3/projects/e6c7de4787bc4d1aa2bef2f59cdafdee/users/2243843372fa48b2a9a96b8073edfa8c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:03.784923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.785260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.785533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.813264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] MFA Rules not processed for user `2243843372fa48b2a9a96b8073edfa8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:03.814498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:03.881340 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1031/2051] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:03.885702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.947963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5a87-5b27-4c37-ac6b-0a668ea5ffeb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.952509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.953103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.953383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.953654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.954287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.956224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.981622 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1021/2052] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:03.985766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.997383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4439-49e6-45f6-99f1-fd325bbdb84d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.053433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.054023 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.054295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.054560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.055169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.057097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.078507 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1032/2053] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:03 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:04.083004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.093002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56100-e50d-429b-8652-b30baa5ca12a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.098009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.098594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.098872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.099143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.099777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.101391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.111615 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1022/2054] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:04.116378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.126229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0617b-f8df-4843-9215-3768c8709521 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.132648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.133214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.133488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.133754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] PATH_INFO: `/v3/projects/1f63df834f8d44318d0df5448b155c57/users/771d8579d6a94b12bbc9446248089b2f/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.148316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f63df834f8d44318d0df5448b155c57, user_id=771d8579d6a94b12bbc9446248089b2f, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.150952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.164472 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1033/2055] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:04 2022] PUT /identity/v3/projects/1f63df834f8d44318d0df5448b155c57/users/771d8579d6a94b12bbc9446248089b2f/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:04.168415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.179328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727cc5e-ee97-46a4-9619-4abff5d8bb00 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.240266 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.240878 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.241418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.241689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.242328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.243962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0010-d18a-49c4-b4fd-63a456a96eb6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.254380 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1023/2056] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:04.258997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.270831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111c5eb-836e-49d3-878c-bb55cfb34dc1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.275396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.276093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.276369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.276633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] PATH_INFO: `/v3/projects/1f63df834f8d44318d0df5448b155c57/users/771d8579d6a94b12bbc9446248089b2f/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.278537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f63df834f8d44318d0df5448b155c57, user_id=771d8579d6a94b12bbc9446248089b2f, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.281254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.292136 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1034/2057] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:04 2022] PUT /identity/v3/projects/1f63df834f8d44318d0df5448b155c57/users/771d8579d6a94b12bbc9446248089b2f/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:04.303080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.303455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.303802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.332662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] MFA Rules not processed for user `771d8579d6a94b12bbc9446248089b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:04.333876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:04.352894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:04.404243 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1024/2058] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:04.415738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.417422 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:04.427686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:04.477981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760eaf-5d7e-4557-b5fe-94092f0dacee admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.481559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.482145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.482418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.482683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.492540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.493961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.503261 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1035/2059] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:04.579048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.588770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34add5e-95bf-4e63-a032-29351ad0d3dc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.592404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.592993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.593270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.593540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.650327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.651770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba486c13-be5c-4801-a115-50a076354a16 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.661389 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1025/2060] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:11.696366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:11.757999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece5c-27d8-4a50-a8e3-f1a014f785b8 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:11.762915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:11.763567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:11.763837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:11.764131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] PATH_INFO: `/v3/users/2243843372fa48b2a9a96b8073edfa8c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:11.765242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2243843372fa48b2a9a96b8073edfa8c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:11.767184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:11.814924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2243843372fa48b2a9a96b8073edfa8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:11.815501 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2243843372fa48b2a9a96b8073edfa8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:11.816324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2243843372fa48b2a9a96b8073edfa8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:11.823416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2243843372fa48b2a9a96b8073edfa8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:11.830237 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2243843372fa48b2a9a96b8073edfa8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:11.848180 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1036/2061] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:11 2022] DELETE /identity/v3/users/2243843372fa48b2a9a96b8073edfa8c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:11.852742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:11.853238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:11.853345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:11.872675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:11.873860 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:11.932662 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1026/2062] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:11.942517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:11.944002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:11.975929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:12.003759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee7aa-e209-4059-8764-2d4f3e5df1bd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:12.007579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:12.008210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:12.008488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:12.008757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:12.017619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:12.019077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:12.028521 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1037/2063] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:12.296224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:12.297626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:12.314407 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666ac0-689e-4a6b-b376-961e69ddf33f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:12.319240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:12.319883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:12.320299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:12.320575 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] PATH_INFO: `/v3/projects/e6c7de4787bc4d1aa2bef2f59cdafdee` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:12.321713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c7de4787bc4d1aa2bef2f59cdafdee)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:12.323629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:12.370131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c7de4787bc4d1aa2bef2f59cdafdee', 'request_id': 'req-37728a4d-f704-4932-a74d-8958997943b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.371355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:12.376737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c7de4787bc4d1aa2bef2f59cdafdee', 'request_id': 'req-37728a4d-f704-4932-a74d-8958997943b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.383257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c7de4787bc4d1aa2bef2f59cdafdee', 'request_id': 'req-37728a4d-f704-4932-a74d-8958997943b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.395928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] The token cache is being invalidate because project e6c7de4787bc4d1aa2bef2f59cdafdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:12.396220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.396863 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.398395 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1027/2064] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:12 2022] DELETE /identity/v3/projects/e6c7de4787bc4d1aa2bef2f59cdafdee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:12.402451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:12.412739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962836-cecd-4b69-917d-18229f89411d service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:12.468536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:12.469154 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:12.469434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:12.469706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] PATH_INFO: `/v3/users/771d8579d6a94b12bbc9446248089b2f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:12.470838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771d8579d6a94b12bbc9446248089b2f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:12.473588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:12.519832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771d8579d6a94b12bbc9446248089b2f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.520507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771d8579d6a94b12bbc9446248089b2f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.521108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771d8579d6a94b12bbc9446248089b2f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.528089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771d8579d6a94b12bbc9446248089b2f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.535877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b17164de-da10-4fe1-a6c1-00ccefe0adc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771d8579d6a94b12bbc9446248089b2f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.553183 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1038/2065] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:12 2022] DELETE /identity/v3/users/771d8579d6a94b12bbc9446248089b2f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:12.823778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:12.825313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:12.845697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728a4d-f704-4932-a74d-8958997943b5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:12.911103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:12.911765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:12.911946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:12.912226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] PATH_INFO: `/v3/projects/1f63df834f8d44318d0df5448b155c57` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:12.913342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f63df834f8d44318d0df5448b155c57)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:12.915256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:12.962139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f63df834f8d44318d0df5448b155c57', 'request_id': 'req-51866c6e-f28a-4168-a06e-aa894a7e791a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.967595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f63df834f8d44318d0df5448b155c57', 'request_id': 'req-51866c6e-f28a-4168-a06e-aa894a7e791a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.974637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f63df834f8d44318d0df5448b155c57', 'request_id': 'req-51866c6e-f28a-4168-a06e-aa894a7e791a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.986979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] The token cache is being invalidate because project 1f63df834f8d44318d0df5448b155c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:12.987267 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.988424 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51866c6e-f28a-4168-a06e-aa894a7e791a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:12.990105 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1028/2066] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:12 2022] DELETE /identity/v3/projects/1f63df834f8d44318d0df5448b155c57 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:12.995255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:12.995716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:12.995819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.015547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:13.016769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:13.060862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:13.078517 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1039/2067] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:13.086254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.086537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.086808 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.106778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:13.107998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:13.117027 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1029/2068] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:13.121359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.131262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386da9-e581-4889-a705-e99397dfc7ee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.135827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.136434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.136713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.136986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.137653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:13.137954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.139568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.151483 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1040/2069] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:13.155721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.166176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c29e9-6220-4587-a18c-8197eb0ead45 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.170722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.171385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.171656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.171965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.172606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.174510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.207081 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1030/2070] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:13.208214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.218429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10b5a5-e434-48f3-bb2f-9f9061ecebf0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.276830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.277434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.277715 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.277986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.278625 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.280583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.302236 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1041/2071] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:13.306448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.317357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3dad-3492-403e-bcb3-b0f35f44eaf3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.321972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.322592 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.322895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.323163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.324052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.325770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.336266 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1031/2072] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:13.340055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.350191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbadc8-eb3a-4aae-ae57-ad18453306fa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.354695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.355278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.355552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.355817 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.356471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.358071 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23e506-dc6b-46b7-955a-b1230698dc3c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.368823 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1042/2073] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:13.372875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.383393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa0f5-9531-4961-91d8-1928a6c17fad admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.387956 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.388662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.388951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.389221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] PATH_INFO: `/v3/projects/022ced0df9b34b0faa405d041087ef89/users/1fac9b6c32b14ae8a61d3f34f800fa70/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.404339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] RBAC: Authorizing `identity:create_grant(project_id=022ced0df9b34b0faa405d041087ef89, user_id=1fac9b6c32b14ae8a61d3f34f800fa70, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.407049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.420072 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1032/2074] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:13 2022] PUT /identity/v3/projects/022ced0df9b34b0faa405d041087ef89/users/1fac9b6c32b14ae8a61d3f34f800fa70/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:13.431678 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.432020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.432301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.460414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] MFA Rules not processed for user `1fac9b6c32b14ae8a61d3f34f800fa70`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:13.461605 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:13.525486 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1043/2075] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:13.529644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.535652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:13.593778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b609309-f2cb-456b-969c-f073314d560e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.598429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.599021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.599296 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.599564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.600217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.602128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.629111 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1033/2076] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:13.633443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.643997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d5f3-bb71-4cb2-933b-db0c9609efe3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.687925 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:13.702647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.703241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.703516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.703785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.704443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.706343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.726969 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1044/2077] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:13.730974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.742461 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20042-dc69-447a-aa71-1930f857c382 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.746978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.747565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.747839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.748140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.748770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.750345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.761264 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1034/2078] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:13.765170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.775013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51de9-a3af-465b-a5ab-46e7f46a3907 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.779522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.780191 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.780466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.780733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] PATH_INFO: `/v3/projects/50d9aefc8eaf40af97fab7b57041d479/users/eda38695b38748e8aa8a96157bcae507/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.795076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d9aefc8eaf40af97fab7b57041d479, user_id=eda38695b38748e8aa8a96157bcae507, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.798160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.811232 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1045/2079] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:13 2022] PUT /identity/v3/projects/50d9aefc8eaf40af97fab7b57041d479/users/eda38695b38748e8aa8a96157bcae507/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:13.815179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.825329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511afb-022a-47d7-9f83-86354fb72ecf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.881020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.881616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.881891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.882158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.882819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.884431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c9331-997e-4ae8-94d1-b3ca39f88d97 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.894567 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1035/2080] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:13.898847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:13.909098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787519b0-19fa-4efc-bb5b-38bbbd79e2b3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:13.914384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:13.915048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.915332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.915600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] PATH_INFO: `/v3/projects/50d9aefc8eaf40af97fab7b57041d479/users/eda38695b38748e8aa8a96157bcae507/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.917524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d9aefc8eaf40af97fab7b57041d479, user_id=eda38695b38748e8aa8a96157bcae507, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:13.920168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:13.930437 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1046/2081] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:13 2022] PUT /identity/v3/projects/50d9aefc8eaf40af97fab7b57041d479/users/eda38695b38748e8aa8a96157bcae507/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:13.940661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:13.941654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:13.941654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:13.968596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] MFA Rules not processed for user `eda38695b38748e8aa8a96157bcae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:13.969781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:14.034665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:14.039284 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1036/2082] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:14.051173 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:14.052990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:14.110015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4c5fd-f2e4-4ffb-965d-cdefc91372c1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:14.114453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:14.115058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:14.115322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:14.115590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:14.173186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:14.174711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26692e-bcf1-41cc-9944-a3e529f0fe85 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:14.183569 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1047/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:16.751726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:16.761881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4f33-522f-4365-ab8c-0d8ffd3957e1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:16.765355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:16.765935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:16.766207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:16.766472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:16.775359 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:16.776822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:16.785938 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1037/2084] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:24.179569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:26.781821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:26.921766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e3db-3d27-44b7-bd77-b74c84ea1147 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:26.922310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e3db-3d27-44b7-bd77-b74c84ea1147 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:26.922449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e3db-3d27-44b7-bd77-b74c84ea1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:26.942636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b140e3db-3d27-44b7-bd77-b74c84ea1147 None None] MFA Rules not processed for user `aacade278860491a9eac6f86b9b2a319`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:26.943835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b140e3db-3d27-44b7-bd77-b74c84ea1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:27.006177 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1048/2085] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:29.528107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.602959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae6ca-28cd-4225-acc9-148e065840d1 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.609154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.610117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.610384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.610874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] PATH_INFO: `/v3/users/1fac9b6c32b14ae8a61d3f34f800fa70` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.613054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fac9b6c32b14ae8a61d3f34f800fa70)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.616931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.688154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fac9b6c32b14ae8a61d3f34f800fa70'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:29.688877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fac9b6c32b14ae8a61d3f34f800fa70'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:29.709357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fac9b6c32b14ae8a61d3f34f800fa70'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:29.730308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fac9b6c32b14ae8a61d3f34f800fa70'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:29.731303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fac9b6c32b14ae8a61d3f34f800fa70'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:29.750504 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1038/2086] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:29 2022] DELETE /identity/v3/users/1fac9b6c32b14ae8a61d3f34f800fa70 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:29.755633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.756491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.756767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.777396 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:29.778883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:29.848944 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1049/2087] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:29.859511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.861211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:29.941733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe965-170d-4890-a907-cb0f419e76ce admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.946106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.946953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.947123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.947394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.958554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.960073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.976057 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1039/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:30.385320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.386821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:30.401392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938056-0e50-4872-b101-ac9419a658ba None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.407318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.407768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.408080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.408350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] PATH_INFO: `/v3/projects/022ced0df9b34b0faa405d041087ef89` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.415431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022ced0df9b34b0faa405d041087ef89)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.418188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.499257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022ced0df9b34b0faa405d041087ef89', 'request_id': 'req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.509743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022ced0df9b34b0faa405d041087ef89', 'request_id': 'req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.518056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022ced0df9b34b0faa405d041087ef89', 'request_id': 'req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.534412 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] The token cache is being invalidate because project 022ced0df9b34b0faa405d041087ef89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:30.535223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.535841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e8c16f5d-e6dc-44ac-8560-6ba5080f5d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.537341 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1050/2089] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:30 2022] DELETE /identity/v3/projects/022ced0df9b34b0faa405d041087ef89 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:30.541514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.559275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4edb-d02b-47c9-a4b8-5baf6afd94bb service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.583032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:30.625401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.626029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.626306 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.626576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] PATH_INFO: `/v3/users/eda38695b38748e8aa8a96157bcae507` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.627694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda38695b38748e8aa8a96157bcae507)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.629708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.677320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda38695b38748e8aa8a96157bcae507'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.678303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda38695b38748e8aa8a96157bcae507'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.686506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda38695b38748e8aa8a96157bcae507'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.698995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda38695b38748e8aa8a96157bcae507'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.699736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda38695b38748e8aa8a96157bcae507'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:30.712879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1040/2090] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:30 2022] DELETE /identity/v3/users/eda38695b38748e8aa8a96157bcae507 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:31.327308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.327806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.328024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.348806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:31.350204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.380135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:31.417734 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1051/2091] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:31.451992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.453422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.501783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.504510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.570341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c9-fabe-4ee4-acd8-22403a63e8c8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.575773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.576443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.576855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.577134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] PATH_INFO: `/v3/projects/50d9aefc8eaf40af97fab7b57041d479` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.578298 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d9aefc8eaf40af97fab7b57041d479)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.580533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.611910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ccede-8119-4e19-b77e-b0b981841e26 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.619160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.620089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.620459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.621267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.633288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.634971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe8e8-b118-4b59-82ed-3c7c1e0d60f0 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.643628 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1052/2092] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:31.644883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d9aefc8eaf40af97fab7b57041d479', 'request_id': 'req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.664092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d9aefc8eaf40af97fab7b57041d479', 'request_id': 'req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.670437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d9aefc8eaf40af97fab7b57041d479', 'request_id': 'req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.690073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] The token cache is being invalidate because project 50d9aefc8eaf40af97fab7b57041d479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:31.690336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.691682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0a8b8ed2-6a0a-4868-8bb9-80e8366c2f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.693918 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1041/2093] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:31 2022] DELETE /identity/v3/projects/50d9aefc8eaf40af97fab7b57041d479 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:31.700604 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.701126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.701609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.729579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:31.730895 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.807896 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1053/2094] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:31.818488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.818794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.819037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.842908 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:31.844220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.857452 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1042/2095] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:31.858556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.869441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b78d1-1a52-4628-a8dc-c7f708a4babf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.875900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.876338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.876609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.876874 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.877540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:31.877838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.880131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.894823 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1054/2096] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:31.899606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.910071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ff6c5-598b-4a2d-a534-fa580ab783e0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.916637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.917408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.917777 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.918058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.918802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.921018 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.952718 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1043/2097] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:31.957205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.967627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985f256-5280-4be6-90e1-f572121b8225 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.022727 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.034074 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.035220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.035711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.036028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.036661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.038599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.061385 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1055/2098] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:32.065066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.076156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e33163-d798-48d7-82f2-14a05f2db50c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.084370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.084979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.085251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.085517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.086166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.087763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.100519 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1044/2099] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:32.104703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.115844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25155a57-d1ab-41ef-b0ac-47048b4396c1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.121159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.121758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.122040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.122305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.122941 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.124567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66eb4a-af5c-414c-ac8c-6aa274402ab9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.139205 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1056/2100] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:32.140514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.151307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b2d9-a4f8-4172-b207-6fa300dc9a31 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.156096 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.156812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.157158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.157497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] PATH_INFO: `/v3/projects/0912ddfa45ba499880245676533f2e6f/users/71925f1d43794b8fab719fa75dd26a95/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.173054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912ddfa45ba499880245676533f2e6f, user_id=71925f1d43794b8fab719fa75dd26a95, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.176436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.192396 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1045/2101] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:32 2022] PUT /identity/v3/projects/0912ddfa45ba499880245676533f2e6f/users/71925f1d43794b8fab719fa75dd26a95/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:32.202918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.203197 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.203491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.233270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] MFA Rules not processed for user `71925f1d43794b8fab719fa75dd26a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:32.234642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.300758 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1057/2102] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:32.305515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.369816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab071c-d480-44f2-9e6e-9b6d0eb5077b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.374473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.375070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.375340 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.375618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.376309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.378709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.407097 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1046/2103] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:32 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:32.411277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.421871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177c32-c8f3-4af8-861a-4fe269da5763 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.480454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.481055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.481332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.481601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.482243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.484172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.525753 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1058/2104] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:32 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:32.530445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.541604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a80c8-812c-4b60-95a9-e48bc588bca7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.546398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.547072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.547419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.547760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.548504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.550727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.564952 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1047/2105] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:32.566861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.579352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e7b0-dba1-4177-a336-63138debcd94 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.584131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.584777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.585055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.585325 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] PATH_INFO: `/v3/projects/ed217674c1b84899981a815640e96606/users/94c965d1f2924fa5b5f8c27a9bd2adad/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.602210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed217674c1b84899981a815640e96606, user_id=94c965d1f2924fa5b5f8c27a9bd2adad, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.604929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.632383 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1059/2106] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:32 2022] PUT /identity/v3/projects/ed217674c1b84899981a815640e96606/users/94c965d1f2924fa5b5f8c27a9bd2adad/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:32.636527 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.646671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48d700-d2ed-4cb4-98ab-83db36fbdc72 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.686973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.706259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.712189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.712189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.712189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.712189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.712189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ff579-ba01-4ef4-a576-c69dc424b4ec admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.720274 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1048/2107] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:32.724514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.734965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50cd55-b6c8-467d-a206-680760ca388d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.740587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.741307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.741916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.742196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] PATH_INFO: `/v3/projects/ed217674c1b84899981a815640e96606/users/94c965d1f2924fa5b5f8c27a9bd2adad/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.744241 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed217674c1b84899981a815640e96606, user_id=94c965d1f2924fa5b5f8c27a9bd2adad, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.746960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.759412 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1060/2108] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:32 2022] PUT /identity/v3/projects/ed217674c1b84899981a815640e96606/users/94c965d1f2924fa5b5f8c27a9bd2adad/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:32.770491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.770862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.771203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.810174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] MFA Rules not processed for user `94c965d1f2924fa5b5f8c27a9bd2adad`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:32.811675 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.881561 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1049/2109] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:32.892092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.894056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.908765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.957518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff83001-7942-4fdd-b73b-ec29241e0ec0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.961137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.961738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.962015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.962281 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.971567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.974038 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37729a00-0ac9-44fc-ac4c-9ffef9a073a3 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.983968 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1061/2110] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:33.653653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:33.739209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafb45a-3478-4c2c-9b88-944c31861119 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:33.746602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:33.747301 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:33.747642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:33.748006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] PATH_INFO: `/v3/users/71925f1d43794b8fab719fa75dd26a95` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:33.749226 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71925f1d43794b8fab719fa75dd26a95)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:33.751245 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:33.833715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71925f1d43794b8fab719fa75dd26a95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.835091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71925f1d43794b8fab719fa75dd26a95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.852205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71925f1d43794b8fab719fa75dd26a95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.864560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:33.871043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71925f1d43794b8fab719fa75dd26a95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.871992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71925f1d43794b8fab719fa75dd26a95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.891680 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1050/2111] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:33 2022] DELETE /identity/v3/users/71925f1d43794b8fab719fa75dd26a95 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:33.896282 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:33.896778 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:33.896872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:33.918951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:33.920300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:34.024230 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1062/2112] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:34.031473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:34.032330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:34.121657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6716-cc68-4542-90e0-c2a2a5b05026 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:34.125710 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:34.126590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:34.126970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:34.127693 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:34.139107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:34.140820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:34.153293 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1051/2113] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:34.591091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:34.594572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:34.633373 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c454-2153-435f-9ab9-f3f7782f8a11 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:34.650123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:34.650772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:34.651049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:34.651318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] PATH_INFO: `/v3/projects/0912ddfa45ba499880245676533f2e6f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:34.652670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0912ddfa45ba499880245676533f2e6f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:34.654626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:34.724029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0912ddfa45ba499880245676533f2e6f', 'request_id': 'req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.735461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0912ddfa45ba499880245676533f2e6f', 'request_id': 'req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.746853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0912ddfa45ba499880245676533f2e6f', 'request_id': 'req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.770070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] The token cache is being invalidate because project 0912ddfa45ba499880245676533f2e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:34.770926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.771964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.773743 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1063/2114] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:34 2022] DELETE /identity/v3/projects/0912ddfa45ba499880245676533f2e6f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:34.777792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:34.789997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35174-d390-4d19-8cda-6d6b59119eda service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:34.864580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:34.865418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:34.865766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:34.866104 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] PATH_INFO: `/v3/users/94c965d1f2924fa5b5f8c27a9bd2adad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:34.867600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c965d1f2924fa5b5f8c27a9bd2adad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:34.869801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:34.942135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c965d1f2924fa5b5f8c27a9bd2adad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.942806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c965d1f2924fa5b5f8c27a9bd2adad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.952536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c965d1f2924fa5b5f8c27a9bd2adad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.969021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c965d1f2924fa5b5f8c27a9bd2adad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.969884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-53feaab5-c6ab-41a6-98cf-399c062e8aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c965d1f2924fa5b5f8c27a9bd2adad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.986295 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1052/2115] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:34 2022] DELETE /identity/v3/users/94c965d1f2924fa5b5f8c27a9bd2adad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:35.859889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.861915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:35.878421 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d9ad-c89a-43a1-8b7d-cfd548022ae1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.923378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:35.953582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.954292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.954700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.955492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] PATH_INFO: `/v3/projects/ed217674c1b84899981a815640e96606` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.956316 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed217674c1b84899981a815640e96606)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.959243 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.025180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed217674c1b84899981a815640e96606', 'request_id': 'req-506e9ed2-f618-4f58-9639-aa883802415a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:36.033598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed217674c1b84899981a815640e96606', 'request_id': 'req-506e9ed2-f618-4f58-9639-aa883802415a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:36.043512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed217674c1b84899981a815640e96606', 'request_id': 'req-506e9ed2-f618-4f58-9639-aa883802415a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:36.070789 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] The token cache is being invalidate because project ed217674c1b84899981a815640e96606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:36.071245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:36.071996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-506e9ed2-f618-4f58-9639-aa883802415a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:36.074046 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1064/2116] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:35 2022] DELETE /identity/v3/projects/ed217674c1b84899981a815640e96606 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:36.079382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.079901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.080124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.091628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:36.109665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:36.111063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.188951 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1053/2117] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:36.198153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.198441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.198712 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.222049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:36.223935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.229135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.230532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.240279 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1065/2118] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:36.244397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.254061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd23c0-6c39-4a84-866f-b4f8cf7b87ee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.260823 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.261686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.262008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.262349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.263069 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:36.263489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.265888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.282721 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1066/2119] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:46:36.288702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.307256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d002c2-c45a-42f9-bfda-2ac988eaf026 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.312891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.313607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.314022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.314437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.315349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.318415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.360661 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1067/2120] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:36.364579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.370716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b6da-3a15-492c-a923-4375613b9607 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.442610 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e32d-8285-4303-862f-59bda907b915 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.447369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.447562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.448034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.448150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.448417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.448535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.448727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.448837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.449463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.450603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.451449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.464517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.466324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.475909 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1068/2121] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:36.479123 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1054/2122] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:36.479811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.492776 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acc766-ced7-44b8-af49-59ba8f5a3cdb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.497881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.498485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.498772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.499044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.499717 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.501369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.516096 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1069/2123] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:46:36.519586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.532930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709068-07bf-4e3b-ac43-2418af5085fb service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.538150 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.538751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.539030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.539302 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.539997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.541624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29bc66-197d-4731-8a4e-c187b7bf1613 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.555911 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1055/2124] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:36.557032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.563247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:36.568403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482585-0543-46a2-9669-fff80a6e0920 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.575711 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.577311 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.577912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.578844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] PATH_INFO: `/v3/projects/09de687e148d4cd7a6255dd939dd387e/users/df76ef042acd40b89bda4f7afc01e3a7/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.601566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09de687e148d4cd7a6255dd939dd387e, user_id=df76ef042acd40b89bda4f7afc01e3a7, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.604521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.628240 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1070/2125] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:36 2022] PUT /identity/v3/projects/09de687e148d4cd7a6255dd939dd387e/users/df76ef042acd40b89bda4f7afc01e3a7/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:36.634071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.634504 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.635199 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.667033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] MFA Rules not processed for user `df76ef042acd40b89bda4f7afc01e3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:36.668327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.682510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:36.743364 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1056/2126] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:36.752517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.755160 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.833043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d68e1-9afa-44c2-8af5-d96b9e5b3d47 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.836910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.837519 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.837795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.838065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.850168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.852131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21a8e6-4be7-4508-b584-20a6eb1cf237 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.864385 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1071/2127] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:36.884955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.950966 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cf73d-95fb-416e-98fd-f00ffcd742e0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.955491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.956147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.957112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.957386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] PATH_INFO: `/v3/users/df76ef042acd40b89bda4f7afc01e3a7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.958600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df76ef042acd40b89bda4f7afc01e3a7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.960564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:37.012393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df76ef042acd40b89bda4f7afc01e3a7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.013682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df76ef042acd40b89bda4f7afc01e3a7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.022008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df76ef042acd40b89bda4f7afc01e3a7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.035429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df76ef042acd40b89bda4f7afc01e3a7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.036155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df76ef042acd40b89bda4f7afc01e3a7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.050367 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1057/2128] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:36 2022] DELETE /identity/v3/users/df76ef042acd40b89bda4f7afc01e3a7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:37.055169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.055454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.055724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.074722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:37.075951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.135673 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1072/2129] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:37.145936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:37.147497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.188219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:37.208759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3780eb-21d6-49b8-9396-1d3a822d1b7c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:37.232036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:37.232759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.232879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.246045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:37.247479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663513-1b99-4458-b835-a3026cf20496 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:37.257935 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1058/2130] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:37.653463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:37.654951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.670649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112f85-fbc5-4b9e-b999-499dd93dfa20 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:37.676786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:37.677502 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.679466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.679745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] PATH_INFO: `/v3/projects/09de687e148d4cd7a6255dd939dd387e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.681730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09de687e148d4cd7a6255dd939dd387e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:37.683721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:37.755013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09de687e148d4cd7a6255dd939dd387e', 'request_id': 'req-d02d589a-e273-419a-885c-22a3e3205432'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.761517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09de687e148d4cd7a6255dd939dd387e', 'request_id': 'req-d02d589a-e273-419a-885c-22a3e3205432'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.772504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09de687e148d4cd7a6255dd939dd387e', 'request_id': 'req-d02d589a-e273-419a-885c-22a3e3205432'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.793296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] The token cache is being invalidate because project 09de687e148d4cd7a6255dd939dd387e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:37.793683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.794402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d02d589a-e273-419a-885c-22a3e3205432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.799401 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1073/2131] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:37 2022] DELETE /identity/v3/projects/09de687e148d4cd7a6255dd939dd387e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:37.801178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.801628 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.801973 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.823827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:37.825087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.896318 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1059/2132] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:37.903632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.904168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.904252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.929026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:37.938907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:37.940176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.963975 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1074/2133] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:37.966659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:37.983133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3a4f0-679e-47d7-8068-6c9c23363a77 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:37.993773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:37.994596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.994869 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.995141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.995803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:37.996210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:37.997915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.024740 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1060/2134] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:38.028821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.039508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2417-81b3-4597-893b-7f5955f0c84d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.044498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.045126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.045405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.045677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.046338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.048351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.088204 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1075/2135] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:38.091379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.112094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a653-392c-4384-b6ed-10ab87f2b7e9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.212495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.213118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.213387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.213663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.214314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.217342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.264212 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1061/2136] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:38.268384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.282499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784607-13a7-4c36-81b2-7bc6be74d4bc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.294223 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.295152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.295644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.296159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.296993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.299021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.314444 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1076/2137] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:38.318579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.335897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c913f-2ed7-4467-acde-000990f5d635 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.347940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.349026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.349553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.350190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.351111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.353160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00c3f9-c282-4360-848a-271f5d91c34e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.370751 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1062/2138] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:38.374651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.391392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1a27b-b2cb-4c5f-9528-e90cee000e96 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.409004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.410261 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.410980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.410980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] PATH_INFO: `/v3/projects/3ee13a26d907467086ccb590ccf81979/users/734648a8b6ec451d8ab54ef9d78ac4b3/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.428105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee13a26d907467086ccb590ccf81979, user_id=734648a8b6ec451d8ab54ef9d78ac4b3, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.431068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.459672 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1077/2139] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:38 2022] PUT /identity/v3/projects/3ee13a26d907467086ccb590ccf81979/users/734648a8b6ec451d8ab54ef9d78ac4b3/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:38.461513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.461802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.462073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.497512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] MFA Rules not processed for user `734648a8b6ec451d8ab54ef9d78ac4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:38.498602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:38.558742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:38.607112 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1063/2140] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:38.618977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.621689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:38.712698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b0957-3c19-4d0f-aae9-a3e97bc2a542 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.721016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.721633 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.721980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.723680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.732496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.733948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.744617 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1078/2141] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:40.205168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.209765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.293107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.295584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.354826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7fd8-0080-4e47-abc4-37b8a365b8c0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.366420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.368605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.371844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.372205 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.377303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.391152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:40.392804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:40.404411 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1064/2142] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:40.435672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d3b7a-84c7-4e78-bfbe-8f3fb8550da2 service glance] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.441361 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.441999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.442299 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.442788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] PATH_INFO: `/v3/users/53358104a2534d9084e19ca4ae59816e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.443912 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53358104a2534d9084e19ca4ae59816e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:40.446179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:40.496767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53358104a2534d9084e19ca4ae59816e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.497458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53358104a2534d9084e19ca4ae59816e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.498059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53358104a2534d9084e19ca4ae59816e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.499810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:40.506397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53358104a2534d9084e19ca4ae59816e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.515571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53358104a2534d9084e19ca4ae59816e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.543895 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1079/2143] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:40 2022] DELETE /identity/v3/users/53358104a2534d9084e19ca4ae59816e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:40.730149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.742458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606785f-f12b-4d86-9750-2864009eb0e6 service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.804775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.805397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.805674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.805950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] PATH_INFO: `/v3/projects/b8734b79aa064e5b9d04494ca7c5112b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.807059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8734b79aa064e5b9d04494ca7c5112b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:40.809000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:40.859130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8734b79aa064e5b9d04494ca7c5112b', 'request_id': 'req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.865484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8734b79aa064e5b9d04494ca7c5112b', 'request_id': 'req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.872276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8734b79aa064e5b9d04494ca7c5112b', 'request_id': 'req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.875148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:40.899589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] The token cache is being invalidate because project b8734b79aa064e5b9d04494ca7c5112b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:40.904178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.905129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:40.906689 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1065/2144] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:40 2022] DELETE /identity/v3/projects/b8734b79aa064e5b9d04494ca7c5112b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:40.911812 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.913475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.927582 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4bfa-a3d6-42af-9889-7c253bad1c86 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.985489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.986112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.986385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.986651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] PATH_INFO: `/v3/users/fd3c8df4f6e947faab75a0eb4f351f77` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.987990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3c8df4f6e947faab75a0eb4f351f77)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:40.989900 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:41.038286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3c8df4f6e947faab75a0eb4f351f77'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.038951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3c8df4f6e947faab75a0eb4f351f77'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.039559 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3c8df4f6e947faab75a0eb4f351f77'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.047821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3c8df4f6e947faab75a0eb4f351f77'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.055409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3c8df4f6e947faab75a0eb4f351f77'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.074990 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1080/2145] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:40 2022] DELETE /identity/v3/users/fd3c8df4f6e947faab75a0eb4f351f77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:41.277374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:41.279062 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:41.293952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6f7b5-dad8-4cc7-ab74-b08f878ae2b0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:41.372293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:41.372978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:41.373264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:41.373539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] PATH_INFO: `/v3/projects/806808391f1c41ff8e8faf005b28c8ce` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:41.375767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=806808391f1c41ff8e8faf005b28c8ce)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:41.377736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:41.446875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806808391f1c41ff8e8faf005b28c8ce', 'request_id': 'req-bc1014b2-da50-45b9-bf1d-5afc02220c1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.453858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806808391f1c41ff8e8faf005b28c8ce', 'request_id': 'req-bc1014b2-da50-45b9-bf1d-5afc02220c1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.461152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806808391f1c41ff8e8faf005b28c8ce', 'request_id': 'req-bc1014b2-da50-45b9-bf1d-5afc02220c1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.486594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] The token cache is being invalidate because project 806808391f1c41ff8e8faf005b28c8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:41.486892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.487607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc1014b2-da50-45b9-bf1d-5afc02220c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:41.503879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1066/2146] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:41 2022] DELETE /identity/v3/projects/806808391f1c41ff8e8faf005b28c8ce => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:51.070980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=65 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:51.480401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:59.962011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:59.963563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:59.977698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35b410-9c2c-4a39-b75c-1b3b0f5fcba1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:00.043572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:00.044245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.044527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.044800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] PATH_INFO: `/v3/users/734648a8b6ec451d8ab54ef9d78ac4b3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.046169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734648a8b6ec451d8ab54ef9d78ac4b3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:00.048246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:00.099220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734648a8b6ec451d8ab54ef9d78ac4b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.101004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734648a8b6ec451d8ab54ef9d78ac4b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.101653 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734648a8b6ec451d8ab54ef9d78ac4b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.109340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734648a8b6ec451d8ab54ef9d78ac4b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.118294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734648a8b6ec451d8ab54ef9d78ac4b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.136737 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1081/2147] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:59 2022] DELETE /identity/v3/users/734648a8b6ec451d8ab54ef9d78ac4b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:00.141346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.141840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.141938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.161107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:00.162989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:00.228523 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1067/2148] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:00.235951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:00.237757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:00.295959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a1ea-8b9a-469c-8181-d8b945202534 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:00.300329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:00.301127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.301542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.301813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.311830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:00.313566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f40394-5975-4576-bb18-af377c481e4b service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:00.323652 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1082/2149] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:00.603947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:00.605449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:00.618428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0a953-ce42-4cb2-a665-475d24dad28f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:00.623565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:00.624360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.624752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.625109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] PATH_INFO: `/v3/projects/3ee13a26d907467086ccb590ccf81979` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.626974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee13a26d907467086ccb590ccf81979)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:00.629188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:00.682148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee13a26d907467086ccb590ccf81979', 'request_id': 'req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.688421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee13a26d907467086ccb590ccf81979', 'request_id': 'req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.696318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee13a26d907467086ccb590ccf81979', 'request_id': 'req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.710239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] The token cache is being invalidate because project 3ee13a26d907467086ccb590ccf81979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:00.710672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.711305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-eff468ec-ad33-4ee7-a4ef-5c4eb70f7d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:00.713498 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1068/2150] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:00 2022] DELETE /identity/v3/projects/3ee13a26d907467086ccb590ccf81979 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:00.718402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.718689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.718964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.738104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:00.739304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:00.759500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:00.803752 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1083/2151] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:00.811483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.811769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.812143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.833618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:00.835612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:00.843906 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1069/2152] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:00.848314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:00.858449 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0463b31-0be7-4b2a-80ca-f986e9cff8e0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:00.863231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:00.863984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.864331 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.864694 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.866031 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:00.866459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:00.868419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d2157-9935-4762-b6ef-aef13c05949b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:00.882478 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1084/2153] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:00.887007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:00.896923 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e90842-ecec-4fce-a303-fdda36e801f9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:00.901726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:00.902356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.902635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.902906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.903581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:00.905579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:00.931140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:00.931511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:00.931825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:00.939727 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1070/2154] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:00.944524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:00.956825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] MFA Rules not processed for user `5f9a55c605f04f478d0a71679d8bf6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:00.958040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:01.001905 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:01.009448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f855f5-7424-4dd6-b5e1-3deaf2ede12c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.014881 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1085/2155] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:01.015347 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.015781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.016093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.016366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.016997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.018917 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.046320 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1071/2156] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:00 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:47:01.047670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.058999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2c75-0c6a-4411-bc22-dfeb8b242e6a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.063578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.064208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.064487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.064763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.065435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.067019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.081887 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1086/2157] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:01.083165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.094116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be372eb4-ab90-4185-ab45-05e432626ba8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.099003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.100165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.100465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.100741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.101395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.103017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a842b4-540b-4a25-9810-727162f495fe admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.113520 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1072/2158] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:01.119012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.128762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157293-adff-4a90-a2fb-cece5b443e6f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.134934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.135391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.135666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.135961 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] PATH_INFO: `/v3/projects/6188e222692649e0a71d21f9d5f06333/users/93d90bc318e64e3f81925b470a15de81/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.152553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6188e222692649e0a71d21f9d5f06333, user_id=93d90bc318e64e3f81925b470a15de81, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.155186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.168950 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1087/2159] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:01 2022] PUT /identity/v3/projects/6188e222692649e0a71d21f9d5f06333/users/93d90bc318e64e3f81925b470a15de81/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:01.238097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.238681 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.238786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.268192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] MFA Rules not processed for user `93d90bc318e64e3f81925b470a15de81`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:01.269401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:01.334240 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1073/2160] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:01.338718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.405577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e7841-4c0e-4c8b-a5c2-e0a938363dd0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.410752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.411484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.412477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.412908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.413675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.415584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.446001 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1088/2161] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:01.447453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.458210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943bfab-614f-4e5f-a58f-49012009d2e3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.522830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.523429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.523705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.524010 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.524680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.526607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.549157 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1074/2162] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:01.554392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.561111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:01.564997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839847-9820-48b7-9d9e-aad7a415ec98 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.571336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.571960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.572233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.572500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.573129 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.574714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.585958 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1089/2163] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:47:01.589925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.600757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9b98b-3429-4766-8030-471b2ffa058a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.606143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.606802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.607151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.608055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.608708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.610342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da2368-ab1b-46e6-92dd-5e2c16f80ba4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.623203 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1075/2164] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:01.627663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.638522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8e08-3f6b-400b-8f69-8964f9173d06 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.644887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.644887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.644887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.644887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] PATH_INFO: `/v3/projects/773dfbeafaf446aa984fdec56c46c270/users/9e7d556fa2c74b409043f3810e589a09/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.675335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=773dfbeafaf446aa984fdec56c46c270, user_id=9e7d556fa2c74b409043f3810e589a09, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.678504 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.694633 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1090/2165] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:01 2022] PUT /identity/v3/projects/773dfbeafaf446aa984fdec56c46c270/users/9e7d556fa2c74b409043f3810e589a09/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:01.704821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.705126 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.706285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.749737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] MFA Rules not processed for user `9e7d556fa2c74b409043f3810e589a09`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:01.750936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:01.781970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:01.818313 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1076/2166] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:01.822746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.890262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c72cf-8832-4a52-b18a-7754bdb02d6a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:01.895872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:01.897218 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:01.897541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:01.897811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:01.898548 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:01.900378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:01.931607 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1091/2167] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:01.935687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:01.946449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0607087-bcf6-4b72-93c0-9d1cd9d8fba8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.007206 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.007911 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.008237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.008564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.009355 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.011541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.034732 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1077/2168] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:01 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:02.038986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:02.049426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a83ff-918f-41a8-8c85-91f78076f0e4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.054107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.054693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.054972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.055244 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.055906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.057517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.070474 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1092/2169] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:02.075481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:02.086909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476e050-5197-4916-a002-943afd6b964b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.092715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.093624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.093913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.094186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] PATH_INFO: `/v3/projects/271f81dee2e347e193e0ebfebaf44d80/users/176e05ca2c7d4b9488c0831d4780b4ba/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.110086 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271f81dee2e347e193e0ebfebaf44d80, user_id=176e05ca2c7d4b9488c0831d4780b4ba, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.113146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.126866 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1078/2170] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:02 2022] PUT /identity/v3/projects/271f81dee2e347e193e0ebfebaf44d80/users/176e05ca2c7d4b9488c0831d4780b4ba/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:02.131515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:02.142830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845d23-bd9e-4572-835a-1d5f286737c5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.201824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.202425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.202706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.202976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.203613 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.205250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8832-4675-4f07-ab86-4d91be8e6b8d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.216912 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1093/2171] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:02.221305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:02.232357 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e129-90d9-47d7-b0aa-5095582d8108 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.236955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.237602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.237909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.238183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] PATH_INFO: `/v3/projects/271f81dee2e347e193e0ebfebaf44d80/users/176e05ca2c7d4b9488c0831d4780b4ba/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.240814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271f81dee2e347e193e0ebfebaf44d80, user_id=176e05ca2c7d4b9488c0831d4780b4ba, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.243711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.254611 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1079/2172] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:02 2022] PUT /identity/v3/projects/271f81dee2e347e193e0ebfebaf44d80/users/176e05ca2c7d4b9488c0831d4780b4ba/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:02.264661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.264943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.265217 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.294298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] MFA Rules not processed for user `176e05ca2c7d4b9488c0831d4780b4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:02.295513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:02.325742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:02.371608 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1094/2173] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:02.383546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:02.385313 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:02.444566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c778-dd36-4ecb-bb09-48a6ad01dd97 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:02.448372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:02.448968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:02.449249 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:02.449519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:02.489439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:02.508457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:02.509894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:02.518629 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1080/2174] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:04.094879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:04.096348 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:04.108970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca288f-ac7b-4655-9cf2-3e782cbe3b16 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:04.112505 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:04.113107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:04.113384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:04.113651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:04.170930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:04.172409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:04.181916 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1095/2175] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:04.744082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:04.752637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907b49-9bba-4385-9080-70d6556e5f9b service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:04.756331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:04.756939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:04.757219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:04.757481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:04.766450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:04.767909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a968e8-710b-46bd-84a9-38ada75fe9aa service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:04.778030 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1081/2176] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:08.663189 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.732408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886bf19-d100-408e-88a2-1d0329b28380 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.736795 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.737414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.737689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.737956 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] PATH_INFO: `/v3/users/93d90bc318e64e3f81925b470a15de81` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.739079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d90bc318e64e3f81925b470a15de81)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.742350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.789831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d90bc318e64e3f81925b470a15de81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:08.790463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d90bc318e64e3f81925b470a15de81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:08.791052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d90bc318e64e3f81925b470a15de81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:08.798205 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d90bc318e64e3f81925b470a15de81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:08.806163 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d90bc318e64e3f81925b470a15de81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:08.808010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:08.824434 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1096/2177] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:08 2022] DELETE /identity/v3/users/93d90bc318e64e3f81925b470a15de81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:08.828963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.829466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.829577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.848090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:08.849798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:08.906884 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1082/2178] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:08.917227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.918642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:08.977427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73db78-6628-4964-adfe-f1a4d26ef124 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.980967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.981562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.981833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.982099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.991915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.993591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:09.002791 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1097/2179] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:09.268277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:09.269715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:09.282321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63b09-bd14-464b-b8b3-b9bcde840d99 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:09.287585 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:09.288178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:09.288450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:09.288720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] PATH_INFO: `/v3/projects/6188e222692649e0a71d21f9d5f06333` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:09.289875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6188e222692649e0a71d21f9d5f06333)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:09.291974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:09.338253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6188e222692649e0a71d21f9d5f06333', 'request_id': 'req-488eba1e-9d91-4083-acdf-f39b15066f2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.343843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6188e222692649e0a71d21f9d5f06333', 'request_id': 'req-488eba1e-9d91-4083-acdf-f39b15066f2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.351000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6188e222692649e0a71d21f9d5f06333', 'request_id': 'req-488eba1e-9d91-4083-acdf-f39b15066f2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.363532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] The token cache is being invalidate because project 6188e222692649e0a71d21f9d5f06333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:09.363841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.364477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.366120 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1083/2180] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:09 2022] DELETE /identity/v3/projects/6188e222692649e0a71d21f9d5f06333 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:09.370497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:09.380111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5a34d-bad0-49af-b7bc-22d0d4d005f5 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:09.436229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:09.436852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:09.437126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:09.437392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] PATH_INFO: `/v3/users/9e7d556fa2c74b409043f3810e589a09` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:09.438495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7d556fa2c74b409043f3810e589a09)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:09.440451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:09.489424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7d556fa2c74b409043f3810e589a09'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.490931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7d556fa2c74b409043f3810e589a09'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.491675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7d556fa2c74b409043f3810e589a09'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.500697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7d556fa2c74b409043f3810e589a09'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.508433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7d556fa2c74b409043f3810e589a09'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.529527 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1098/2181] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:09 2022] DELETE /identity/v3/users/9e7d556fa2c74b409043f3810e589a09 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:09.812518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:09.813939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:09.828066 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eba1e-9d91-4083-acdf-f39b15066f2c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:09.878307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:09.895260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:09.895909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:09.896979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:09.897184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] PATH_INFO: `/v3/projects/773dfbeafaf446aa984fdec56c46c270` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:09.899046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] RBAC: Authorizing `identity:delete_project(project_id=773dfbeafaf446aa984fdec56c46c270)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:09.901019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:09.948454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773dfbeafaf446aa984fdec56c46c270', 'request_id': 'req-e76b22a4-6b36-474e-821c-779e2ca4271e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.953835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773dfbeafaf446aa984fdec56c46c270', 'request_id': 'req-e76b22a4-6b36-474e-821c-779e2ca4271e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.961258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773dfbeafaf446aa984fdec56c46c270', 'request_id': 'req-e76b22a4-6b36-474e-821c-779e2ca4271e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.975068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] The token cache is being invalidate because project 773dfbeafaf446aa984fdec56c46c270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:09.975354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.976084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:09.977546 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1084/2182] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:09 2022] DELETE /identity/v3/projects/773dfbeafaf446aa984fdec56c46c270 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:09.981597 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:09.983179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:09.993759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:09.998257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1160-47e2-4c01-99bc-293017230530 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.058434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:10.059068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.059411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.059622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] PATH_INFO: `/v3/users/176e05ca2c7d4b9488c0831d4780b4ba` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.060780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=176e05ca2c7d4b9488c0831d4780b4ba)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:10.062750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:10.127379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176e05ca2c7d4b9488c0831d4780b4ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.128170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176e05ca2c7d4b9488c0831d4780b4ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.128836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176e05ca2c7d4b9488c0831d4780b4ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.142590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176e05ca2c7d4b9488c0831d4780b4ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.151996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1f8012a-6929-49b3-833c-94fe7fef27ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176e05ca2c7d4b9488c0831d4780b4ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.175303 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1099/2183] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:09 2022] DELETE /identity/v3/users/176e05ca2c7d4b9488c0831d4780b4ba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:10.489918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:10.492387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:10.516636 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b22a4-6b36-474e-821c-779e2ca4271e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.588515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:10.588515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.588515 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.588968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] PATH_INFO: `/v3/projects/271f81dee2e347e193e0ebfebaf44d80` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.590165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271f81dee2e347e193e0ebfebaf44d80)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:10.592175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:10.646200 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271f81dee2e347e193e0ebfebaf44d80', 'request_id': 'req-9f416290-be77-4265-83ed-1a0be6d9c3f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.656404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271f81dee2e347e193e0ebfebaf44d80', 'request_id': 'req-9f416290-be77-4265-83ed-1a0be6d9c3f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.665919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271f81dee2e347e193e0ebfebaf44d80', 'request_id': 'req-9f416290-be77-4265-83ed-1a0be6d9c3f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.684705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] The token cache is being invalidate because project 271f81dee2e347e193e0ebfebaf44d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:10.684987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.685616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9f416290-be77-4265-83ed-1a0be6d9c3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:10.687433 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1085/2184] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:10 2022] DELETE /identity/v3/projects/271f81dee2e347e193e0ebfebaf44d80 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:10.692386 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.692662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.692930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.716216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:10.717434 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:10.794307 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1100/2185] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:10.803819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.804148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.804426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.825348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:10.826623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:10.835352 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1086/2186] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:10.840494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:10.853409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a6219-9dbf-4c3d-a1d2-dbb8fa90b89b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.861048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:10.861639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.862001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.862279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.862942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:10.863245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:10.865358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:10.879673 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1101/2187] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:10.888955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:10.894713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:10.902393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfcd12-532a-4c5f-94d4-e238278f730a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.910319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:10.910992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.911279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.911555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.912280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:10.914209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:10.944713 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1087/2188] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:10.949146 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:10.961357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304f8c9-635f-445d-87d1-a536d0f4727e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.970403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:11.027402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:11.028175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.028453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.028767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.029849 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:11.032304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:11.056499 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1102/2189] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:10 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:11.060818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:11.073892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca7d6-f6a6-4d1e-875d-4af12cea4349 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:11.078871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:11.079511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.079792 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.080105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.080786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:11.082680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:11.100119 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1088/2190] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:11.101714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:11.113077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33116a-8e54-493f-b383-f90257e4fc0a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:11.118945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:11.119689 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.119959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.120270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.121098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:11.122699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b5bc-48b3-48a5-bd13-f875feb8e2d0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:11.134781 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1103/2191] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:11.139094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:11.150886 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507bc1-aef5-4893-99f7-a8a6f7e70562 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:11.156387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:11.157074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.157279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.157554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] PATH_INFO: `/v3/projects/6f437b7c89fa48dc839af13f942ed788/users/3363aad3a712488dafad983f16ac029c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.176128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f437b7c89fa48dc839af13f942ed788, user_id=3363aad3a712488dafad983f16ac029c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:11.179346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:11.192427 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1089/2192] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:11 2022] PUT /identity/v3/projects/6f437b7c89fa48dc839af13f942ed788/users/3363aad3a712488dafad983f16ac029c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:11.202830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.203142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.203464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.236512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] MFA Rules not processed for user `3363aad3a712488dafad983f16ac029c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:11.237713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:11.303163 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1104/2193] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:11.314075 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:11.315790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:11.373569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade0590-de06-48d0-accf-a3e3c35ecb83 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:11.377179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:11.377778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:11.378056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:11.378334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:11.386677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:11.388136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d588f-f404-4afd-bd3f-1405474e6d51 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:11.397180 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1090/2194] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:21.299390 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:21.392768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:21.552123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:21.615138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331f88-34f2-49d0-8090-aacac73abbf9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:21.620831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:21.621457 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:21.621735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:21.621997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] PATH_INFO: `/v3/users/3363aad3a712488dafad983f16ac029c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:21.623170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] RBAC: Authorizing `identity:delete_user(user_id=3363aad3a712488dafad983f16ac029c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:21.625144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:21.673278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3363aad3a712488dafad983f16ac029c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:21.673931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3363aad3a712488dafad983f16ac029c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:21.674526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3363aad3a712488dafad983f16ac029c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:21.682050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3363aad3a712488dafad983f16ac029c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:21.689000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3363aad3a712488dafad983f16ac029c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:21.706558 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1105/2195] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:21 2022] DELETE /identity/v3/users/3363aad3a712488dafad983f16ac029c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:21.712195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:21.712477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:21.712748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:21.732614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:21.733797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:21.793283 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1091/2196] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:21.803260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:21.805175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:21.869143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57d379-1aec-49ef-b647-bac70965eede admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:21.872854 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:21.873461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:21.873738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:21.874008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:21.883677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:21.885153 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23cdba-e6fb-487c-b1e5-b828be8c6d3b service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:21.894833 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1106/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:22.159386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:22.160836 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:22.175514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f6fe7-19ec-4ba9-81ca-6d2442a1f4ab None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:22.180720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:22.181341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:22.181613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:22.181879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] PATH_INFO: `/v3/projects/6f437b7c89fa48dc839af13f942ed788` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:22.183046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f437b7c89fa48dc839af13f942ed788)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:22.186523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:22.235452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f437b7c89fa48dc839af13f942ed788', 'request_id': 'req-dba61852-db11-47ae-929f-86d60ae0bc51'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.240927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f437b7c89fa48dc839af13f942ed788', 'request_id': 'req-dba61852-db11-47ae-929f-86d60ae0bc51'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.247920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f437b7c89fa48dc839af13f942ed788', 'request_id': 'req-dba61852-db11-47ae-929f-86d60ae0bc51'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.261070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] The token cache is being invalidate because project 6f437b7c89fa48dc839af13f942ed788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:22.261369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.261982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.263759 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1092/2198] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:22 2022] DELETE /identity/v3/projects/6f437b7c89fa48dc839af13f942ed788 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:30.928256 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:30.928767 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:30.929306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:30.958049 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:30.969424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:30.970807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:31.054863 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1107/2199] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:31.066806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:31.068236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:31.158963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:31.161631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61852-db11-47ae-929f-86d60ae0bc51 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:31.168991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:31.169764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:31.170044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:31.170314 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:31.178168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:31.179910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694b92-0aaf-4225-bc37-fe80eb79993e service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:31.188046 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1093/2200] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:47:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:41.053099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=35 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:41.184694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:44.549984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:44.551475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:44.648757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4031-6162-4237-bd34-6628c1e0f9d7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:44.653974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:44.654614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:44.654852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:44.655122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:44.656845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:44.669770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:44.671344 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed524-600a-4ae9-8dd6-c04cafa0ec82 service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:44.681704 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1108/2201] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:45.895676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:45.896291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:45.896615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:45.898422 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1094/2202] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:45.905201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a8e9-8cbb-4ae4-a446-c0e8d2f4e6d8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:45.905695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a8e9-8cbb-4ae4-a446-c0e8d2f4e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:45.905794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a8e9-8cbb-4ae4-a446-c0e8d2f4e6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:45.950673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1ce0a8e9-8cbb-4ae4-a446-c0e8d2f4e6d8 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:45.951781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1ce0a8e9-8cbb-4ae4-a446-c0e8d2f4e6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.030318 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1109/2203] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:46.041725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:46.043377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.101790 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caeeba-e163-4962-8368-079deef19ed6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:46.105286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:46.105870 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.106142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.106409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.117146 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:46.118809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03dad5-525d-4605-b0c5-70d0ef0f3b6d service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:46.129267 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1095/2204] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:46.206377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.206377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.206377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.207747 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1110/2205] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:46.212464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aec9a-b5fb-43ae-bb96-29b544756762 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.212751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aec9a-b5fb-43ae-bb96-29b544756762 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.213059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aec9a-b5fb-43ae-bb96-29b544756762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.245488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-aa3aec9a-b5fb-43ae-bb96-29b544756762 None None] MFA Rules not processed for user `8f4e1ab258e946cb935116e6c71bbd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:46.246788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-aa3aec9a-b5fb-43ae-bb96-29b544756762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.307409 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1096/2206] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:46.319379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:46.321077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.334029 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc093-8155-4d88-8798-3abb2f856987 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:46.337537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:46.338111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.338382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.338647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.345462 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:46.346876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde500c6-4f65-47d9-9447-e02fb0df2892 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:46.355055 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1111/2207] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:46.437084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.437395 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.437672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.439073 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1097/2208] 10.222.0.33 () {54 vars in 921 bytes} [Wed Oct 19 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:46.443916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e27e3-f473-48cd-ac79-082194537b62 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.444409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e27e3-f473-48cd-ac79-082194537b62 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.445103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e27e3-f473-48cd-ac79-082194537b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.464594 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b10e27e3-f473-48cd-ac79-082194537b62 None None] MFA Rules not processed for user `08d6104d22ff4bb1bd295d99ca3c5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:46.465698 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b10e27e3-f473-48cd-ac79-082194537b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.474657 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1112/2209] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Oct 19 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:46.485615 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:46.487285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.501803 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad99f2-5d86-4522-b179-199a44df31c7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:46.505252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:46.505832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.506115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.506376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.517392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:46.518794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:46.530180 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1098/2210] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:48.375935 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7dade-2b7e-49cb-9078-abb6b34c2218 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:48.376418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7dade-2b7e-49cb-9078-abb6b34c2218 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:48.376660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7dade-2b7e-49cb-9078-abb6b34c2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:48.398626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7df7dade-2b7e-49cb-9078-abb6b34c2218 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:48.399875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7df7dade-2b7e-49cb-9078-abb6b34c2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:48.407129 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1113/2211] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:47:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:48.419228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:48.431208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f88b-7b96-4fc7-9401-f5e256657d99 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:48.436091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:48.436667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:48.436941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:48.437204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:48.446048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:48.447639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:48.455383 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1099/2212] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:58.393506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:58.452198 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=70 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:08.146896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:08.147388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:08.147493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:08.166876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:08.168196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:08.175149 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1114/2213] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:48:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:08.187332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:08.198581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93b81-f5c8-4cbf-ac6f-46b8cee956bf service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:08.203596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:08.204231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:08.204509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:08.204775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:08.213826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:08.215556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:08.223415 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1100/2214] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:48:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:18.162095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:18.220303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:32.304720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:32.314083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85c704-d771-44db-825a-81f12ba0b541 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:32.317788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:32.318531 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:32.318875 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:32.319297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:32.321326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:32.406388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:32.407828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:32.427017 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1115/2215] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:35.655388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:35.655388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:35.669731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca414-ee84-4ee6-a413-11a159ff78d8 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:35.674458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:35.675604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:35.675915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:35.676204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] PATH_INFO: `/v3/users/aacade278860491a9eac6f86b9b2a319` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:35.677318 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacade278860491a9eac6f86b9b2a319)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:35.679457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:35.730898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacade278860491a9eac6f86b9b2a319'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:35.731554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacade278860491a9eac6f86b9b2a319'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:35.739004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacade278860491a9eac6f86b9b2a319'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:35.752286 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacade278860491a9eac6f86b9b2a319'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:35.752946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-adab775e-95a4-4597-969c-b3210c36e416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacade278860491a9eac6f86b9b2a319'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:35.766913 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1101/2216] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:35 2022] DELETE /identity/v3/users/aacade278860491a9eac6f86b9b2a319 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:35.951743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:35.963364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d975-862f-4abd-810a-07e26edaf6bd service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.023389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.024042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.024318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.024587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] PATH_INFO: `/v3/projects/f150d0c748e54c3eb4943b2b41adb99a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.025682 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f150d0c748e54c3eb4943b2b41adb99a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.027728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.073647 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f150d0c748e54c3eb4943b2b41adb99a', 'request_id': 'req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:36.079728 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f150d0c748e54c3eb4943b2b41adb99a', 'request_id': 'req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:36.086083 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f150d0c748e54c3eb4943b2b41adb99a', 'request_id': 'req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:36.089860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:36.100600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] The token cache is being invalidate because project f150d0c748e54c3eb4943b2b41adb99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:36.101097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:36.101916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b7fb0d50-e8f9-4e40-bfd0-afff2efbadd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:36.103440 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1116/2217] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:35 2022] DELETE /identity/v3/projects/f150d0c748e54c3eb4943b2b41adb99a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:36.108949 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.109234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.109505 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.159203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:36.160443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:36.218760 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1102/2218] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:36.227724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.228033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.228303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.248696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:36.249891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:36.257691 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1117/2219] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:36.262550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.272593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484dc2-1cb2-4396-bad1-469ddab24ec2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.277653 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.278247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.278655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.279884 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.280668 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:36.280805 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.282405 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.294996 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1103/2220] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:36.299410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.309526 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5661ccf-b37a-4918-9bfe-9c70d83b8469 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.314377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.314999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.315278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.315568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.316227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.318210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.347541 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1118/2221] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:36.351621 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.363391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331d4a-8e80-4ebd-b4c3-ae8f6fec37ce admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.398153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:36.423383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.424011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.424288 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.424559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.425189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.427160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.449093 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1104/2222] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:36.453214 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.463441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357513f1-4f9f-40bb-a154-399ea93ad780 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.468301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.468883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.469177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.469441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.470073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.471662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.482508 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1119/2223] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:36.486412 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.497270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9e3a4-85e4-4290-828a-8bdea5927a64 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.501922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.502509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.502789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.503063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.503715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.505321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb47944-338e-40d5-b424-0133d81b67a2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.517282 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1105/2224] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:36.521371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.531410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248289c3-9937-4885-af05-b8972cc43808 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.536194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.536831 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.537104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.537380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] PATH_INFO: `/v3/projects/76779bd930604ba6bc01dcb526703e4a/users/30f9a39adb2b430a9d6fe2642933d25f/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.553183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76779bd930604ba6bc01dcb526703e4a, user_id=30f9a39adb2b430a9d6fe2642933d25f, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.555793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.568358 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1120/2225] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:36 2022] PUT /identity/v3/projects/76779bd930604ba6bc01dcb526703e4a/users/30f9a39adb2b430a9d6fe2642933d25f/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:36.579224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.579503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.579771 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.607069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] MFA Rules not processed for user `30f9a39adb2b430a9d6fe2642933d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:36.608218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:36.672294 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1106/2226] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:36.676780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.737998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf275c-7e5d-40c6-9164-529beb109f93 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.742641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.743230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.743510 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.743781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.744436 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.747242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.772963 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1121/2227] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:36.777597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.788375 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6796c7-374e-4fad-a6e4-79edf7309810 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.844423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.845009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.845283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.845543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.846175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.848099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.869993 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1107/2228] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:36 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:36.874300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.884464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7cd63-02e6-4a1e-be12-b689042b1724 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.889072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.889659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.889938 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.890209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.890843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.892478 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.903444 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1122/2229] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:36.907443 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.918109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db861-6057-4882-99a9-d919891ca907 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:36.922833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:36.923478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:36.923757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:36.924067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] PATH_INFO: `/v3/projects/d763133e690940fb92596cad04285656/users/90476eb9198142c496a7611b652ad952/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:36.938652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d763133e690940fb92596cad04285656, user_id=90476eb9198142c496a7611b652ad952, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:36.941358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:36.954033 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1108/2230] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:36 2022] PUT /identity/v3/projects/d763133e690940fb92596cad04285656/users/90476eb9198142c496a7611b652ad952/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:36.958113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:36.968781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331a7b8-78d8-449a-897e-ced2c7cc4531 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:37.024983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:37.025577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.025856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.026693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.027323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:37.028942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f072fd-b65b-43a6-a53b-e0338835f32c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:37.038528 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1123/2231] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:37.043244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:37.053380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da0ae-2bd8-4bbd-be03-61c4c40ac6ff admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:37.058064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:37.058704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.058989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.059257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] PATH_INFO: `/v3/projects/d763133e690940fb92596cad04285656/users/90476eb9198142c496a7611b652ad952/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.061218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d763133e690940fb92596cad04285656, user_id=90476eb9198142c496a7611b652ad952, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:37.063846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:37.069252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:37.075052 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1109/2232] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:37 2022] PUT /identity/v3/projects/d763133e690940fb92596cad04285656/users/90476eb9198142c496a7611b652ad952/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:37.085211 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.085499 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.085772 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.093369 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:37.115310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] MFA Rules not processed for user `90476eb9198142c496a7611b652ad952`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:37.116549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:37.183899 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1124/2233] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:37.194872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:37.196787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:37.274536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f184-051a-420a-bd38-e9b2c28980c4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:37.279279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:37.279895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.280174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.280444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.289331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:37.290748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85fea-49a3-4eea-a320-cc2917237a5f service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:37.300224 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1110/2234] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:37.709057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:37.770790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda75c8-17b2-4843-ba67-1eb79c139a4f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:37.775252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:37.775889 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.776717 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.776953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] PATH_INFO: `/v3/users/30f9a39adb2b430a9d6fe2642933d25f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.778065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f9a39adb2b430a9d6fe2642933d25f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:37.780015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:37.825896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f9a39adb2b430a9d6fe2642933d25f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:37.826612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f9a39adb2b430a9d6fe2642933d25f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:37.827206 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f9a39adb2b430a9d6fe2642933d25f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:37.834853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f9a39adb2b430a9d6fe2642933d25f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:37.842943 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f9a39adb2b430a9d6fe2642933d25f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:37.861479 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1125/2235] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:37 2022] DELETE /identity/v3/users/30f9a39adb2b430a9d6fe2642933d25f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:37.866154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:37.866602 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:37.866852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:37.886743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:37.888107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:37.949843 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1111/2236] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:37.960716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:37.964655 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:37.976405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.030068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3672b-6281-473e-955c-b42e647eeef0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.034532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.035156 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.035441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.035708 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.046717 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.048270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.059253 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1126/2237] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:38.368778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.370835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:38.383577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c1ff-1212-4660-b6bc-8ba32e096c5e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.388426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.389539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.389989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.390264 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] PATH_INFO: `/v3/projects/76779bd930604ba6bc01dcb526703e4a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.391387 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76779bd930604ba6bc01dcb526703e4a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.393370 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.440225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76779bd930604ba6bc01dcb526703e4a', 'request_id': 'req-51dcb070-057b-4a6a-9fb3-a58957045357'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.445705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76779bd930604ba6bc01dcb526703e4a', 'request_id': 'req-51dcb070-057b-4a6a-9fb3-a58957045357'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.452378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76779bd930604ba6bc01dcb526703e4a', 'request_id': 'req-51dcb070-057b-4a6a-9fb3-a58957045357'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.464663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] The token cache is being invalidate because project 76779bd930604ba6bc01dcb526703e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:38.464943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.465548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.467002 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1112/2238] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:38 2022] DELETE /identity/v3/projects/76779bd930604ba6bc01dcb526703e4a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:38.470926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.481095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ef71d-ab58-4e4a-bc45-daf2a11bb982 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.537479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.538106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.538380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.538650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] PATH_INFO: `/v3/users/90476eb9198142c496a7611b652ad952` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.539754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90476eb9198142c496a7611b652ad952)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.542416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.587371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90476eb9198142c496a7611b652ad952'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.588032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90476eb9198142c496a7611b652ad952'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.589176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90476eb9198142c496a7611b652ad952'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.597192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90476eb9198142c496a7611b652ad952'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.604824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee9dcb58-5809-4611-a5a2-b078252d103d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90476eb9198142c496a7611b652ad952'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.623502 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1127/2239] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:38 2022] DELETE /identity/v3/users/90476eb9198142c496a7611b652ad952 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:38.895254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.896732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:38.907969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.912730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcb070-057b-4a6a-9fb3-a58957045357 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.974237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.974895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.975181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.975453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] PATH_INFO: `/v3/projects/d763133e690940fb92596cad04285656` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.976589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d763133e690940fb92596cad04285656)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.978512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.025611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd763133e690940fb92596cad04285656', 'request_id': 'req-671fc454-967f-494e-ac18-389438ddd2bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:39.031764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd763133e690940fb92596cad04285656', 'request_id': 'req-671fc454-967f-494e-ac18-389438ddd2bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:39.037926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd763133e690940fb92596cad04285656', 'request_id': 'req-671fc454-967f-494e-ac18-389438ddd2bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:39.053156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] The token cache is being invalidate because project d763133e690940fb92596cad04285656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:39.053444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:39.054085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-671fc454-967f-494e-ac18-389438ddd2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:39.055550 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1113/2240] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:38 2022] DELETE /identity/v3/projects/d763133e690940fb92596cad04285656 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:39.060573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.061075 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.061185 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.080508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:39.081637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.106037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.143327 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1128/2241] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:39.152841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.153128 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.153404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.174855 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:39.176073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.184275 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1114/2242] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:39.188664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.198337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb4f12-706e-423d-aa36-ce4a4b1cbd2b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.202891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.203483 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.203758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.204055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.204721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:39.205019 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.206635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.219048 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1129/2243] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:39.223465 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.233143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60007559-f1c1-40f0-a5cf-34ee112a8c78 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.237730 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.238319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.238593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.238859 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.239539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.241480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.269173 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1115/2244] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:39.273461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.284105 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de56c-f78d-498c-bf15-b12f966fc36a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.346056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.346580 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.346852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.347118 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.347742 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.349670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.371655 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1130/2245] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:39.375183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.385899 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446967e-bcf4-460c-ad95-248822915dbe admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.390540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.391121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.391396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.391664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.392352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.393946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.404727 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1116/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:39.408446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.418592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d828-a1ec-4dc1-b069-66682319c753 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.423169 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.423752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.424061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.424333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.424967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.426557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efd59b-46f8-496e-bceb-559b1cbdabb3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.437185 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1131/2247] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:39.441049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.451477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e354-5485-4ac7-8543-a519ad7b9ea0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.456140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.456835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.457069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.457315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] PATH_INFO: `/v3/projects/0749e14819594422811b5c11c1714454/users/eb42d5b689a64f7ba6483da8bc17bd46/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.471815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0749e14819594422811b5c11c1714454, user_id=eb42d5b689a64f7ba6483da8bc17bd46, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.474455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.487431 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1117/2248] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:39 2022] PUT /identity/v3/projects/0749e14819594422811b5c11c1714454/users/eb42d5b689a64f7ba6483da8bc17bd46/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:39.498536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.498826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.499099 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.526140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] MFA Rules not processed for user `eb42d5b689a64f7ba6483da8bc17bd46`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:39.527346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.590558 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1132/2249] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:39.594989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.629131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.666222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035666a-94d1-4249-8787-68573ff0079f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.671413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.672046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.672323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.672591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.673227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.675127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.701974 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1118/2250] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:39.706203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.717159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d11da6-f2f1-4b23-ae53-63158ab7d12e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.736995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.774894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.775492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.775773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.776677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.777229 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.779143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.800257 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1133/2251] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:39.804374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.815091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daa7fc-8e62-479a-b770-d410a83c1be9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.819712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.820328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.820607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.820877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.821507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.823261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.833618 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1119/2252] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:39.837756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.848075 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e032df-00c9-4c00-9f9c-4089b3956e83 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.852753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.853383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.853655 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.853921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] PATH_INFO: `/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad/users/37e884aad90d4e09bc0e01bde65bd5c1/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.869400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c76f7803fb49cc9e701bdf093dfcad, user_id=37e884aad90d4e09bc0e01bde65bd5c1, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.872432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.884627 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1134/2253] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:39 2022] PUT /identity/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad/users/37e884aad90d4e09bc0e01bde65bd5c1/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:39.889212 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.899082 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bc1e7-e4d0-4385-8786-82ecf1931adf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.955001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.955726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.956090 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.956411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.957047 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.958642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d90c24-8b96-405d-b2e9-3e857bec7ae8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.968954 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1120/2254] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:39.973165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.984366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33bc80-3707-4ffc-ac28-9c36dac62087 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.988847 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.989474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.989749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.990015 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] PATH_INFO: `/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad/users/37e884aad90d4e09bc0e01bde65bd5c1/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.991908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c76f7803fb49cc9e701bdf093dfcad, user_id=37e884aad90d4e09bc0e01bde65bd5c1, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.994508 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:40.006049 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1135/2255] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:39 2022] PUT /identity/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad/users/37e884aad90d4e09bc0e01bde65bd5c1/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:40.017383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:40.017658 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:40.017935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:40.046253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] MFA Rules not processed for user `37e884aad90d4e09bc0e01bde65bd5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:40.047457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:40.113276 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1121/2256] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:40.124783 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:40.126487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:40.185439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb17c46-b086-4153-879b-e24d4193a673 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:40.189034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:40.189616 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:40.189888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:40.190152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:40.199829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:40.201273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:40.210494 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1136/2257] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:40.287254 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:40.297043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c802db-2090-41ca-9b13-0e78295f295d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:40.300761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:40.301422 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:40.301768 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:40.302111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:40.326766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:40.364524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:40.366111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fe9dc-bd1b-41e3-9d44-79024588789d service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:40.376231 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1122/2258] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:50.206392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:50.371684 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=16 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:55.411203 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:55.484238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b689a-0477-47f0-8fbd-b4df00775419 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:55.489651 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:55.490378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:55.490732 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:55.491053 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] PATH_INFO: `/v3/users/eb42d5b689a64f7ba6483da8bc17bd46` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:55.493180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb42d5b689a64f7ba6483da8bc17bd46)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:55.494599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:55.552845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb42d5b689a64f7ba6483da8bc17bd46'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:55.553768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb42d5b689a64f7ba6483da8bc17bd46'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:55.554745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb42d5b689a64f7ba6483da8bc17bd46'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:55.564284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb42d5b689a64f7ba6483da8bc17bd46'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:55.572967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb42d5b689a64f7ba6483da8bc17bd46'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:55.598264 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1137/2259] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:55 2022] DELETE /identity/v3/users/eb42d5b689a64f7ba6483da8bc17bd46 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:55.602867 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:55.603352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:55.603466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:55.630442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:55.631664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:55.692931 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1123/2260] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:55.703894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:55.705537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:55.770357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89376-ffe1-4b8f-9445-c06bb76377ac admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:55.774273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:55.774919 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:55.775204 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:55.775536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:55.790890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:55.794374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:55.806184 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1138/2261] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:56.137476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.139091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.159927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094953d-87aa-42b3-b443-25a08175a0ef None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.165282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.166012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.168118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.168118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] PATH_INFO: `/v3/projects/0749e14819594422811b5c11c1714454` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.169673 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0749e14819594422811b5c11c1714454)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.171690 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:56.233400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0749e14819594422811b5c11c1714454', 'request_id': 'req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.241053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0749e14819594422811b5c11c1714454', 'request_id': 'req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.252851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0749e14819594422811b5c11c1714454', 'request_id': 'req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.262380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.264025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.273821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] The token cache is being invalidate because project 0749e14819594422811b5c11c1714454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:56.274121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.275043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.277501 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1124/2262] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:56 2022] DELETE /identity/v3/projects/0749e14819594422811b5c11c1714454 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:56.278060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba64c7-8ab1-4d25-b917-6a8a91fbcd49 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.285767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.287179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.307425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:56.350432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.350977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.351269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.351535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.353332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.366370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.369092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:56.378582 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1139/2263] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:48:56.380353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc0c9-0414-4e22-82f7-fe1c1a4f3718 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.385225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.386098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.386391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.386657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] PATH_INFO: `/v3/users/37e884aad90d4e09bc0e01bde65bd5c1` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.387819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e884aad90d4e09bc0e01bde65bd5c1)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.390604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:56.428764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:56.451757 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e884aad90d4e09bc0e01bde65bd5c1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.452519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e884aad90d4e09bc0e01bde65bd5c1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.460168 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e884aad90d4e09bc0e01bde65bd5c1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.460942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.462490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.473001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e884aad90d4e09bc0e01bde65bd5c1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.473643 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e884aad90d4e09bc0e01bde65bd5c1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:56.473859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f224-79c4-4404-ba62-98fc02712522 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.477425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.478072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.478343 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.478620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.480417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.486257 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1125/2264] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:56 2022] DELETE /identity/v3/users/37e884aad90d4e09bc0e01bde65bd5c1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:56.557774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.559500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1e18-f926-4495-a15a-899d50427a12 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:56.571507 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1140/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:48:56.857091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.858862 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.967255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776378b-1ce2-42cb-b6a1-d0bfb8b54815 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.972109 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.972734 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.972996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.973263 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] PATH_INFO: `/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.974349 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c76f7803fb49cc9e701bdf093dfcad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.976339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.030300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c76f7803fb49cc9e701bdf093dfcad', 'request_id': 'req-20b4f461-c1bc-4afb-ab14-43375871a7b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:57.036231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c76f7803fb49cc9e701bdf093dfcad', 'request_id': 'req-20b4f461-c1bc-4afb-ab14-43375871a7b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:57.043020 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c76f7803fb49cc9e701bdf093dfcad', 'request_id': 'req-20b4f461-c1bc-4afb-ab14-43375871a7b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:57.056993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] The token cache is being invalidate because project b7c76f7803fb49cc9e701bdf093dfcad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:57.058091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:57.058717 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-20b4f461-c1bc-4afb-ab14-43375871a7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:57.060454 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1126/2266] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:56 2022] DELETE /identity/v3/projects/b7c76f7803fb49cc9e701bdf093dfcad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:57.065561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.065873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.066152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.089021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:57.090357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:57.151404 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1141/2267] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:57.160439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.160731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.161026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.183694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:57.184825 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:57.193344 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1127/2268] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:57.198557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.208378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c943a41-0b3e-48d8-a3d4-284f5d854e2b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.212972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.213672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.213982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.214254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.214888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:57.215226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.217093 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.228674 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1142/2269] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:57.232998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.242315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95ba8-bb65-40d1-8dc8-62b5fda2f983 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.247963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.248556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.248837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.249105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.249740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.251633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.280151 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1128/2270] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:57.284355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.294126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a867f16-1d7c-4ed9-b474-307cb69161ea admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.329234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:57.352198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.352803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.353086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.353357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.354524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.356755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.381567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1143/2271] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:57.385897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.393319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:57.397488 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc634-c3ee-41c8-8ac9-63abf943ca0c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.404124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.404883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.405223 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.405672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.406327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.407968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.418681 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1129/2272] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:57.422640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.434068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e524-e7f0-4e22-a948-2977569e076a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.439192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.439921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.440194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.440459 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.441096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.442672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950aa6-dc9f-4d1a-8986-6783c4399d5c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.456707 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1144/2273] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:57.458273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.468972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0e845-0a9a-4b89-8e4c-3f20a8d502aa admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.475252 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.476022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.476322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.476562 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] PATH_INFO: `/v3/projects/1640109d4c1d4a469b392424c6a71052/users/38d149d74a5043a0b8f4698da49acc19/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.502865 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1640109d4c1d4a469b392424c6a71052, user_id=38d149d74a5043a0b8f4698da49acc19, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.505770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.522235 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1130/2274] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:57 2022] PUT /identity/v3/projects/1640109d4c1d4a469b392424c6a71052/users/38d149d74a5043a0b8f4698da49acc19/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:57.533752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.534150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.534305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.562825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] MFA Rules not processed for user `38d149d74a5043a0b8f4698da49acc19`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:57.564393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:57.636839 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1145/2275] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:57.647731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:57.649489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:57.710706 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f9729-81fd-49ee-aab8-73cd48461808 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:57.715378 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:57.716004 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.716285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.716558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:57.725640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:57.727067 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:57.736299 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1131/2276] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:58.080602 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:58.082114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:58.142542 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901285b-4725-48c8-946b-127f3d86e652 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:58.147777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:58.148416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:58.148696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:58.148967 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:58.150707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:58.216080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:58.218931 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:58.220608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:58.232253 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1146/2277] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:01.776141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:01.777781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:01.792969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58d9ee-a3e9-47bc-ba79-61ec912a15f6 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:01.797419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:01.798034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:01.798312 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:01.798584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] PATH_INFO: `/v3/users/5f9a55c605f04f478d0a71679d8bf6a1` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:01.799698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9a55c605f04f478d0a71679d8bf6a1)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:01.801712 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:01.849682 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9a55c605f04f478d0a71679d8bf6a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:01.850320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9a55c605f04f478d0a71679d8bf6a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:01.858309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9a55c605f04f478d0a71679d8bf6a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:01.871635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9a55c605f04f478d0a71679d8bf6a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:01.872546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bebbdad8-02c2-4143-b27f-c67998e7bc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9a55c605f04f478d0a71679d8bf6a1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:01.885131 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1132/2278] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:01 2022] DELETE /identity/v3/users/5f9a55c605f04f478d0a71679d8bf6a1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:02.065209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.075630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd040a3-217b-49a3-a25e-dad3e7aa5b2d service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.162794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.163418 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.163697 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.164070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] PATH_INFO: `/v3/projects/4081d4f735b04367a67a03b9539f5432` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.165117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4081d4f735b04367a67a03b9539f5432)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.167595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.230353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4081d4f735b04367a67a03b9539f5432', 'request_id': 'req-9291e0c9-0dc5-4ebe-8235-3bc286182368'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:02.236762 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4081d4f735b04367a67a03b9539f5432', 'request_id': 'req-9291e0c9-0dc5-4ebe-8235-3bc286182368'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:02.243802 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4081d4f735b04367a67a03b9539f5432', 'request_id': 'req-9291e0c9-0dc5-4ebe-8235-3bc286182368'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:02.258456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] The token cache is being invalidate because project 4081d4f735b04367a67a03b9539f5432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:02.258829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:02.259453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9291e0c9-0dc5-4ebe-8235-3bc286182368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:02.261418 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1147/2279] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:02 2022] DELETE /identity/v3/projects/4081d4f735b04367a67a03b9539f5432 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:02.266213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.266494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.266767 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.287480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:02.288747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:02.332525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:02.357125 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1133/2280] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:02.367374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.367954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.368260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.393930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:02.395670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:02.405762 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1148/2281] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:02.410015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.421030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c8c6-0935-4691-bcce-5127e72a6b6d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.426794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.427484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.427766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.428077 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.428769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:02.429074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.430726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.444709 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1134/2282] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:02.449159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.459277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0839b-0b60-406d-8961-0fc41b427e39 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.464799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.465123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.465397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.465662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.466298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.468277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.497507 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1149/2283] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:02 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:02.501665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.512188 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673871-5735-4bdc-b75b-3811e8397233 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.576289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.576910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.577171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.577566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.578165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.580116 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.610782 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1135/2284] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:02 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:02.610979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.618713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398cb8-3ee9-4d5e-be73-ff8da6660e70 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.624250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.624848 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.625126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.626027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.626828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.628479 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.639481 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1150/2285] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:02.643596 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.654055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa11c4-ce6a-4284-a39c-95ac38dca283 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.658839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.659434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.659713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.660050 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.660724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.662404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a434676-9148-46f3-88de-4159a0111193 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.674653 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1136/2286] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:02.678707 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.691137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effdad-94ce-4b16-b9fd-6ed324f4ac39 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.695660 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.696329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.696615 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.696884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] PATH_INFO: `/v3/projects/6c432fb744f74646bc63fd9b3913b79b/users/46fdeb6fb08b4daf9f266238786803ca/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.712879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c432fb744f74646bc63fd9b3913b79b, user_id=46fdeb6fb08b4daf9f266238786803ca, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.717177 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.730814 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1151/2287] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:02 2022] PUT /identity/v3/projects/6c432fb744f74646bc63fd9b3913b79b/users/46fdeb6fb08b4daf9f266238786803ca/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:02.735844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.736192 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.736464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.757664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:02.758883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:02.820648 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1137/2288] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:02.830806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:02.832586 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:02.859564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:02.894102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6df01-be25-488e-b369-ed79ee88f3c5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:02.897750 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:02.898351 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:02.898636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:02.898902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:02.908718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:02.910158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0834e-9bda-4081-af94-4c6f700aa56f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:02.919940 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1152/2289] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:03.242794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.245992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.261981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22431c57-6c05-4b0c-90b0-356739a3df48 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.267416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.268255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.268393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.268597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] PATH_INFO: `/v3/users/38d149d74a5043a0b8f4698da49acc19` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.270279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d149d74a5043a0b8f4698da49acc19)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.271789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.336909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:03.341356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d149d74a5043a0b8f4698da49acc19'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:03.343236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d149d74a5043a0b8f4698da49acc19'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:03.353518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d149d74a5043a0b8f4698da49acc19'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:03.371453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d149d74a5043a0b8f4698da49acc19'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:03.372473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d149d74a5043a0b8f4698da49acc19'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:03.394897 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1138/2290] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:03 2022] DELETE /identity/v3/users/38d149d74a5043a0b8f4698da49acc19 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:03.399309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce892d-1147-4de5-99f2-c5e0488f3adc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.399798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce892d-1147-4de5-99f2-c5e0488f3adc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.399957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce892d-1147-4de5-99f2-c5e0488f3adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.421080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d3ce892d-1147-4de5-99f2-c5e0488f3adc None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:03.422392 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d3ce892d-1147-4de5-99f2-c5e0488f3adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.492569 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1153/2291] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:03.504791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.506499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.576792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.577232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.577701 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abafe2-430e-42f3-8ce8-0a71b95a9c75 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.577837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.581749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.582477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.582760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.583040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.593348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.595121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.611291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] MFA Rules not processed for user `46fdeb6fb08b4daf9f266238786803ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:03.612862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.613484 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1139/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:03.719011 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1154/2293] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:03.724579 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.726383 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.749351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb238aa5-7c1e-4c53-9732-cb36746e7f32 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.755562 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.756386 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.756664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.757473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.758260 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.760626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.802519 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1140/2294] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:03 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:03.803503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.816477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7803-b047-4432-a93c-79577ec635a3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.876248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:03.883382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.884042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.884287 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.884553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.885857 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.887768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.911930 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1155/2295] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:03 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:03.913517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.924124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a664-d79a-486b-a693-3fa969b65e61 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.928736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.929333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.929607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.929873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.930508 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.932723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.943451 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1141/2296] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:03.947487 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.958511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3ca05-882a-4165-8faa-27528e22a791 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.963696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.964511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.964799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.965073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] PATH_INFO: `/v3/projects/506ea01e8c0349ccac74d1a54f1067d8/users/e59fb9d25e1748998d70b63014aec10b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.969007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:03.970898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:03.982799 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506ea01e8c0349ccac74d1a54f1067d8, user_id=e59fb9d25e1748998d70b63014aec10b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:03.985592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:03.988876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e1c3-e351-43ee-b6dc-13179c589b17 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:03.996015 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:03.997477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:03.998172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:03.998517 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] PATH_INFO: `/v3/projects/1640109d4c1d4a469b392424c6a71052` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:03.999804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1640109d4c1d4a469b392424c6a71052)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.002101 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.002230 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1156/2297] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:03 2022] PUT /identity/v3/projects/506ea01e8c0349ccac74d1a54f1067d8/users/e59fb9d25e1748998d70b63014aec10b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:04.006346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.063963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1640109d4c1d4a469b392424c6a71052', 'request_id': 'req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:04.071372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1640109d4c1d4a469b392424c6a71052', 'request_id': 'req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:04.079745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1640109d4c1d4a469b392424c6a71052', 'request_id': 'req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:04.080842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f583-f89b-4dde-97a8-f2f08facf769 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.094809 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] The token cache is being invalidate because project 1640109d4c1d4a469b392424c6a71052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:04.095197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:04.095896 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-68afbba5-a3a6-484f-9a7a-215e70ac8dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:04.097838 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1142/2298] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:03 2022] DELETE /identity/v3/projects/1640109d4c1d4a469b392424c6a71052 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:04.102283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544780-15b4-4bfa-9e15-f074daa985b8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.102565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544780-15b4-4bfa-9e15-f074daa985b8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.102837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544780-15b4-4bfa-9e15-f074daa985b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.126858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-23544780-15b4-4bfa-9e15-f074daa985b8 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:04.128912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-23544780-15b4-4bfa-9e15-f074daa985b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:04.142011 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:04.147639 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.148315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.148684 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.149043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.149629 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.151631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.163040 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1157/2299] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:04.167773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.170182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:04.186452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4404a1-0283-49dc-9270-0cd7466ecad0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.191228 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.191974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.192254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.192528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] PATH_INFO: `/v3/projects/506ea01e8c0349ccac74d1a54f1067d8/users/e59fb9d25e1748998d70b63014aec10b/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.194550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506ea01e8c0349ccac74d1a54f1067d8, user_id=e59fb9d25e1748998d70b63014aec10b, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.197467 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.205062 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1143/2300] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:04.212442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.212727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.213000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.218334 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1158/2301] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:04 2022] PUT /identity/v3/projects/506ea01e8c0349ccac74d1a54f1067d8/users/e59fb9d25e1748998d70b63014aec10b/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:04.241000 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:04.242881 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:04.313546 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1144/2302] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:04.318327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.332255 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867e02-3863-45bd-a528-05f3b6180227 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.338560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.339537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.339966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.340124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.340892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:04.341803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.343547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.361067 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1159/2303] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:04.362656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.374920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaf6e5-8d1f-428b-b810-bc6ad4c63469 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.380134 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.380864 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.381177 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.381538 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.382325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.384327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.423907 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1145/2304] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:04.425059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.436006 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c35e-41c9-4eef-8cdb-032a1f65a7e3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.469447 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:04.497389 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.498024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.498306 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.498574 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.499222 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.501186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.527637 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1160/2305] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:04.528843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.539309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3fd1-c82d-4941-8be4-3e3468d6023f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.544969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.545567 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.546006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.546321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.547017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.549013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.559259 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1146/2306] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:04.563828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.585196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee00dc-c77a-427b-88ff-b4edaf5f3fc8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.592435 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.593070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.594008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.594322 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.594974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.596614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d526864-1e9f-4562-93cd-35ab932010c5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.608190 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1161/2307] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:04.612290 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.625285 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109ef8-9279-491a-91b0-032f774d0280 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.630119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.630773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.631051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.631324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] PATH_INFO: `/v3/projects/a3b65c39836d4deab6d694b865cc0bfe/users/b872d18558a64030ac16d97cbca7a88c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.649171 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b65c39836d4deab6d694b865cc0bfe, user_id=b872d18558a64030ac16d97cbca7a88c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.652761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.666943 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1147/2308] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:04 2022] PUT /identity/v3/projects/a3b65c39836d4deab6d694b865cc0bfe/users/b872d18558a64030ac16d97cbca7a88c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:04.677688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.678030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.678269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.709087 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] MFA Rules not processed for user `b872d18558a64030ac16d97cbca7a88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:04.710356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:04.779697 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1162/2309] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:04.815812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.817726 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:04.880554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e6f8-eef5-469a-a73b-d9aac24abccc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:04.884414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:04.885022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.885330 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.885601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.894635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:04.896174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22734fa3-b3bc-46b9-addd-8ccd26f77819 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:04.907087 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1148/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:04.925928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:04.929623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d3e-6195-4b73-a6d6-888e2ad00079 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:04.930085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d3e-6195-4b73-a6d6-888e2ad00079 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:04.930210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d3e-6195-4b73-a6d6-888e2ad00079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:04.939055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:04.965063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c69d6d3e-6195-4b73-a6d6-888e2ad00079 None None] MFA Rules not processed for user `e59fb9d25e1748998d70b63014aec10b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:04.965872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c69d6d3e-6195-4b73-a6d6-888e2ad00079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:05.000056 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39b572-f043-47e1-902f-36a3accbf832 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:05.005954 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:05.006649 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:05.006862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:05.007137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] PATH_INFO: `/v3/users/b872d18558a64030ac16d97cbca7a88c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:05.008329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b872d18558a64030ac16d97cbca7a88c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:05.010540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:05.048658 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1149/2311] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:05.070301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b872d18558a64030ac16d97cbca7a88c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:05.070966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b872d18558a64030ac16d97cbca7a88c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:05.071567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b872d18558a64030ac16d97cbca7a88c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:05.074121 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:05.083436 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b872d18558a64030ac16d97cbca7a88c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:05.096929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b872d18558a64030ac16d97cbca7a88c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:05.118994 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1163/2312] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:04 2022] DELETE /identity/v3/users/b872d18558a64030ac16d97cbca7a88c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:05.124816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:05.125228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:05.125655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:05.146136 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:05.147605 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:05.221953 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1150/2313] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:05.232626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:05.234065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:05.330148 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d0bcb-7e13-4f08-98bf-db249c452d5e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:05.333915 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:05.335756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:05.335756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:05.335756 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:05.349835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:05.352025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d312f-d0ca-4f2a-8720-1c58f201fd31 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:05.363962 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1164/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:05.943234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:05.945566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:05.959752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ec82-803e-46fa-aecb-5a42c92c10a7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:05.967341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:05.968299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:05.968835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:05.969222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] PATH_INFO: `/v3/projects/a3b65c39836d4deab6d694b865cc0bfe` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:05.970556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b65c39836d4deab6d694b865cc0bfe)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:05.972800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.055242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b65c39836d4deab6d694b865cc0bfe', 'request_id': 'req-bd390194-b969-4e62-9036-38305335d1d6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.063310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b65c39836d4deab6d694b865cc0bfe', 'request_id': 'req-bd390194-b969-4e62-9036-38305335d1d6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.073685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b65c39836d4deab6d694b865cc0bfe', 'request_id': 'req-bd390194-b969-4e62-9036-38305335d1d6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.089409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] The token cache is being invalidate because project a3b65c39836d4deab6d694b865cc0bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:06.089925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.090580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bd390194-b969-4e62-9036-38305335d1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.092142 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1151/2315] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:05 2022] DELETE /identity/v3/projects/a3b65c39836d4deab6d694b865cc0bfe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:06.097380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.097859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.097979 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.122686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:06.123945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.187311 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1165/2316] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:06.195797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.196125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.196398 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.218721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:06.219977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.227842 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1152/2317] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:06.233410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.242855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f55a-740b-4327-9db7-135b8adb1910 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.248536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.249002 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.249274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.249539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.250213 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:06.250512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.252208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.264819 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1166/2318] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:06.269118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.274665 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:06.280358 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01e13-56be-4f01-8858-ffde6da5c36d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.286142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.286748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.287027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.287333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.287960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.290059 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.322850 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1153/2319] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:06 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:06.324145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.334533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10509a-1a13-4c57-a2db-0c641fabe3e8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.394259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:06.408741 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.409607 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.409828 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.410073 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.411079 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.413562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.417514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.419555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.436737 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06847c7-8d74-4ab6-aa70-6182bf3f3c62 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.441814 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1167/2320] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:06 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:06.442814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.444657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.445281 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.445555 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.445821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] PATH_INFO: `/v3/users/46fdeb6fb08b4daf9f266238786803ca` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.446927 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fdeb6fb08b4daf9f266238786803ca)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.449519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.452554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fabf-bcbf-4227-b90e-852dda8af3b0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.457253 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.457835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.458112 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.458376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.459063 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.460659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.473301 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1168/2321] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:06.477372 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.488040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94ed5a-df9e-4a01-9e16-ce96924ce805 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.492696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.493231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.493506 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.493774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.494399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.497024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.500406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fdeb6fb08b4daf9f266238786803ca'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.501147 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fdeb6fb08b4daf9f266238786803ca'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.507597 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1169/2322] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:06.509742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fdeb6fb08b4daf9f266238786803ca'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.512027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.513677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.522614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fdeb6fb08b4daf9f266238786803ca'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.523633 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d01ef555-9075-417d-b0ad-766f4e99ef4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fdeb6fb08b4daf9f266238786803ca'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.526127 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361931-6e87-4c42-9b4a-978698826642 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.531352 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.532030 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.532520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.532641 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] PATH_INFO: `/v3/projects/57d54fe92a8f46d29b670a333be0df06/users/2cb777fa264a42ee8c0873c7f2293cde/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.536538 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1154/2323] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:06 2022] DELETE /identity/v3/users/46fdeb6fb08b4daf9f266238786803ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:06.548231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d54fe92a8f46d29b670a333be0df06, user_id=2cb777fa264a42ee8c0873c7f2293cde, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.550877 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.565054 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1170/2324] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:06 2022] PUT /identity/v3/projects/57d54fe92a8f46d29b670a333be0df06/users/2cb777fa264a42ee8c0873c7f2293cde/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:06.575476 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.575709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.576071 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.605392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] MFA Rules not processed for user `2cb777fa264a42ee8c0873c7f2293cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:06.606616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.677711 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1155/2325] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:06.691178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.692987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.726912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.728540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:06.756870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27307de3-df68-4b33-aa1b-90d53c4338c3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.762288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.762986 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.763270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.763538 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.775150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.777310 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.787297 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1171/2326] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:06.793597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:06.820008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da4a73-9b67-492f-b2e1-f3a70443e52c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:06.826339 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:06.826804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:06.826912 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:06.827160 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] PATH_INFO: `/v3/projects/6c432fb744f74646bc63fd9b3913b79b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:06.828367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c432fb744f74646bc63fd9b3913b79b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:06.830303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:06.907632 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c432fb744f74646bc63fd9b3913b79b', 'request_id': 'req-c393ebaf-9c53-462c-880e-46b374861709'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.914910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c432fb744f74646bc63fd9b3913b79b', 'request_id': 'req-c393ebaf-9c53-462c-880e-46b374861709'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.922749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c432fb744f74646bc63fd9b3913b79b', 'request_id': 'req-c393ebaf-9c53-462c-880e-46b374861709'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.937698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] The token cache is being invalidate because project 6c432fb744f74646bc63fd9b3913b79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:06.937922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.940272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:06.945036 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1156/2327] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:06 2022] DELETE /identity/v3/projects/6c432fb744f74646bc63fd9b3913b79b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:06.945990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:06.960067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909f0e-6b9e-4f72-b043-754f9a78b27e service glance] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.024551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.025236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.025448 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.025718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] PATH_INFO: `/v3/users/e59fb9d25e1748998d70b63014aec10b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.027469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59fb9d25e1748998d70b63014aec10b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.029419 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.082718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:07.086022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59fb9d25e1748998d70b63014aec10b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.087239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59fb9d25e1748998d70b63014aec10b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.088050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59fb9d25e1748998d70b63014aec10b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.097867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59fb9d25e1748998d70b63014aec10b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.110309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-07045f3e-3af2-4681-b4ca-09404907507a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59fb9d25e1748998d70b63014aec10b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.142958 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1172/2328] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:06 2022] DELETE /identity/v3/users/e59fb9d25e1748998d70b63014aec10b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:07.401589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:07.403428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:07.428830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393ebaf-9c53-462c-880e-46b374861709 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.497040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.497646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.497889 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.498161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] PATH_INFO: `/v3/projects/506ea01e8c0349ccac74d1a54f1067d8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.499329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506ea01e8c0349ccac74d1a54f1067d8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.501507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.554036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506ea01e8c0349ccac74d1a54f1067d8', 'request_id': 'req-f29c6f93-e6f8-42f5-a273-e0032122ab79'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.560572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506ea01e8c0349ccac74d1a54f1067d8', 'request_id': 'req-f29c6f93-e6f8-42f5-a273-e0032122ab79'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.567774 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506ea01e8c0349ccac74d1a54f1067d8', 'request_id': 'req-f29c6f93-e6f8-42f5-a273-e0032122ab79'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.582391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] The token cache is being invalidate because project 506ea01e8c0349ccac74d1a54f1067d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:07.582746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.583356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f29c6f93-e6f8-42f5-a273-e0032122ab79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:07.584983 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1157/2329] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:07 2022] DELETE /identity/v3/projects/506ea01e8c0349ccac74d1a54f1067d8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:07.590667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.590995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.591360 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.612798 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:07.613927 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:07.696337 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1173/2330] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:07.700695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.700989 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.701230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.711361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:07.726061 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:07.727970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:07.736218 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1158/2331] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:07.740551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:07.752050 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21d18-c000-4137-b88e-75752b3d1d55 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.757972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.758719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.758996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.759265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.759948 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:07.760969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.763329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.779002 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1174/2332] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:07.782053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:07.792217 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0f1f-3b28-42cf-b29a-ca409db7a941 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.797019 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.797656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.797936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.798207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.798882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.801068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.838738 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1159/2333] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:07 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:07.840172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:07.850532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bd81-3b78-41f1-a029-a208f03dfb24 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.918067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.918853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.919248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.919563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.920458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.922816 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.955525 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1175/2334] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:07 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:07.955902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:07.969993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c5cc-57fc-4dbb-93ee-dd457d96791d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:07.976194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:07.976987 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:07.977310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:07.977582 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:07.978291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:07.980806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:07.997468 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1160/2335] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:08.012179 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.039091 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35a515-6d39-4edd-80cb-3600fde15725 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.047657 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.049108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.049108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.049108 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.050111 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.051878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d807d-f1e9-4a68-a575-94e4d165dc95 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.087397 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1176/2336] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:08.092350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.110578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b60e0d-e24d-4041-bb7e-b5651747ee9e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.128310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.129001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.129274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.129550 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] PATH_INFO: `/v3/projects/522866debb894299bd724249975f5dda/users/5698bef99f504be18b0be737426cd438/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.167483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522866debb894299bd724249975f5dda, user_id=5698bef99f504be18b0be737426cd438, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.171590 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.191672 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1161/2337] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:08 2022] PUT /identity/v3/projects/522866debb894299bd724249975f5dda/users/5698bef99f504be18b0be737426cd438/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:08.203092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.203092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.203561 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.255813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] MFA Rules not processed for user `5698bef99f504be18b0be737426cd438`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:08.257088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:08.279589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:08.346304 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1177/2338] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:08.350844 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.427496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83fce-8cac-4c60-b07f-19170f2ac692 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.433118 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.434164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.434462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.434729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.435363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.437304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.469846 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1162/2339] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:08 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:08.474060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.485305 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f3dc-4394-4601-9c76-6fb7cdd51102 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.548583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.549193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.549475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.549747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.550376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.552338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.577848 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1178/2340] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:08 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:08.581909 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.593569 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8918c-1af5-4687-9e0c-c5e0282b2807 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.598942 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.599542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.600013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.600293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.601120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.602972 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.617813 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1163/2341] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:08.626780 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.638663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbdca4-3441-4191-9c68-f1978f0c63c8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.645037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.645939 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.646067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.646245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] PATH_INFO: `/v3/projects/fdbd306ce5b94f19a5f241222705b421/users/eecfba310d544e77a483344bf90779d8/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.677016 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbd306ce5b94f19a5f241222705b421, user_id=eecfba310d544e77a483344bf90779d8, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.685176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.707962 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1179/2342] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:08 2022] PUT /identity/v3/projects/fdbd306ce5b94f19a5f241222705b421/users/eecfba310d544e77a483344bf90779d8/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:08.712098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.726028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63f9e-b0ba-4ead-a31e-249f2b1f02fe admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.802529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.803276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.803816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.804227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.805363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.807342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ad89-3ea0-4699-82f1-fdb30d36db3c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.819234 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1164/2343] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:08.823786 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:08.834768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e693f6-6516-4db9-ab93-12977a27272d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:08.841166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:08.841934 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.842286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.842543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] PATH_INFO: `/v3/projects/fdbd306ce5b94f19a5f241222705b421/users/eecfba310d544e77a483344bf90779d8/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.844599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbd306ce5b94f19a5f241222705b421, user_id=eecfba310d544e77a483344bf90779d8, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:08.847291 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:08.858703 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1180/2344] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:08 2022] PUT /identity/v3/projects/fdbd306ce5b94f19a5f241222705b421/users/eecfba310d544e77a483344bf90779d8/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:08.872048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:08.872482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:08.872761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:08.895180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:08.907079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] MFA Rules not processed for user `eecfba310d544e77a483344bf90779d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:08.908396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:08.987445 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1165/2345] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:09.000247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:09.002193 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:09.070408 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6fba-1249-414e-bdba-5a8751315b02 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:09.075192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:09.075978 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:09.076254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:09.076523 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:09.085985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:09.087427 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:09.097365 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1181/2346] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:09.191748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:09.209381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa256cb6-8186-49e0-8319-69763bca0a4d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:09.213880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:09.214595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:09.214850 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:09.215122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:09.284148 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:09.285587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:09.295880 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1166/2347] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:12.326579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:12.328018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:12.342803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:12.390382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d12b9-9ee6-4fcd-b164-f54bd18d77e5 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:12.394028 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:12.394734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:12.395089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:12.395437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:12.397269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:12.465113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:12.466431 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:12.477190 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1182/2348] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:15.782175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:15.783802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:15.807008 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f867ef-4d15-4e52-8e0e-4c9f3d35c207 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:15.812262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:15.812887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:15.813179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:15.813435 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] PATH_INFO: `/v3/users/59bad833caf84817b8553d699b2fa04f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:15.814572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59bad833caf84817b8553d699b2fa04f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:15.816540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:15.876750 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59bad833caf84817b8553d699b2fa04f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:15.877336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59bad833caf84817b8553d699b2fa04f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:15.888155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59bad833caf84817b8553d699b2fa04f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:15.901274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59bad833caf84817b8553d699b2fa04f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:15.902209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e77c47d-d850-4d09-a59d-d2220bfd107a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59bad833caf84817b8553d699b2fa04f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:15.916788 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1167/2349] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:15 2022] DELETE /identity/v3/users/59bad833caf84817b8553d699b2fa04f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:16.108012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.119159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b8c4-e31f-4ef6-94b2-0faea16e2c46 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.184729 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.185381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.185656 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.186117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] PATH_INFO: `/v3/projects/5e171056a4354ca695c18f115bfb750f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.187317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e171056a4354ca695c18f115bfb750f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.189541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.239452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e171056a4354ca695c18f115bfb750f', 'request_id': 'req-5d614ae3-8365-456d-a81f-871dda3bb2eb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.245883 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e171056a4354ca695c18f115bfb750f', 'request_id': 'req-5d614ae3-8365-456d-a81f-871dda3bb2eb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.252312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e171056a4354ca695c18f115bfb750f', 'request_id': 'req-5d614ae3-8365-456d-a81f-871dda3bb2eb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.253968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:16.266556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] The token cache is being invalidate because project 5e171056a4354ca695c18f115bfb750f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:16.266862 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.267882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5d614ae3-8365-456d-a81f-871dda3bb2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.269299 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1183/2350] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:16 2022] DELETE /identity/v3/projects/5e171056a4354ca695c18f115bfb750f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:16.274417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.274695 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.274961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.290343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:16.298620 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:16.299960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.389070 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1168/2351] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:16.397097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.397380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.397652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.426411 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:16.428224 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.439668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1184/2352] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:16.443997 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.453955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f13d-76c7-4ef4-83ba-671aed8aa983 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.455907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.457774 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.459887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.460558 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.460772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.461045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.461691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:16.461990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.463649 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.475381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211c8f-a38c-4009-b941-c750486ef1b4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.476822 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1169/2353] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:16.481358 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.481644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.482027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.482302 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.482571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] PATH_INFO: `/v3/users/5698bef99f504be18b0be737426cd438` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.483710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5698bef99f504be18b0be737426cd438)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.485661 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.492459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9953-5920-450b-b89f-799059b45fb6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.497969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.498764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.498891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.499105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.499723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.502091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.536709 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1170/2354] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:16.537729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.540984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5698bef99f504be18b0be737426cd438'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.542843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5698bef99f504be18b0be737426cd438'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.543471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5698bef99f504be18b0be737426cd438'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.551451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5698bef99f504be18b0be737426cd438'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.559838 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1a6ae48f-79f6-4816-9cfb-09a902591da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5698bef99f504be18b0be737426cd438'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:16.582967 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1185/2355] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:16 2022] DELETE /identity/v3/users/5698bef99f504be18b0be737426cd438 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:16.587236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.587521 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.588103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.609781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec17a5-933e-4d93-b795-e1658c21ef55 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.610032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:16.611097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.675967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.676573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.676846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.677293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.677406 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1186/2356] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:16.677738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.679677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.687141 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.688490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.707077 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1171/2357] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:16.711032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.712700 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.725402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e0e0-9760-4571-9813-a775c59a7690 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.730779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.731390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.731705 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.731958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.732589 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.734187 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.736691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:16.747457 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1172/2358] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:16.751373 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.755764 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e562f-b1de-4300-a25d-fcc4fb98949b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.759481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.760242 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.760464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.760737 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.762640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5e31-49ee-40a9-a484-d51634b48606 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.767888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.769178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.769462 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.769741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.770389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.771238 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.772093 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8a3a2-a13f-4ece-9253-dae76ed210f8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.773124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.779923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:16.784693 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1173/2359] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:16.785463 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1187/2360] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:16.789150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.800436 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19022a-d57b-4b01-b92b-c076413a837a service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:16.805878 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:16.806585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.806860 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.807771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] PATH_INFO: `/v3/projects/a58e669febcd49499c300594920ba37a/users/20fb9b534a4e4961855b826edbcf7e82/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.825147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58e669febcd49499c300594920ba37a, user_id=20fb9b534a4e4961855b826edbcf7e82, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:16.828608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:16.844125 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1188/2361] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:16 2022] PUT /identity/v3/projects/a58e669febcd49499c300594920ba37a/users/20fb9b534a4e4961855b826edbcf7e82/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:16.857656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:16.857940 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:16.858218 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:16.894490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] MFA Rules not processed for user `20fb9b534a4e4961855b826edbcf7e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:16.896158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:16.984117 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1174/2362] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:16.996564 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:16.998426 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:17.082126 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3d74-3fe2-400e-b54f-5bc4b2283165 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:17.090905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:17.091516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:17.091882 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:17.092081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:17.096454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:17.097887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:17.101650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:17.105047 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:17.115838 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1189/2363] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:17.179541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b016a1-c6f0-481e-9a1c-c26358d80d8c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:17.184230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:17.184847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:17.185121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:17.185392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] PATH_INFO: `/v3/projects/522866debb894299bd724249975f5dda` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:17.186540 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522866debb894299bd724249975f5dda)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:17.188475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:17.241574 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522866debb894299bd724249975f5dda', 'request_id': 'req-a4552403-4f45-4ca3-97e3-cf456eb60803'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.249124 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522866debb894299bd724249975f5dda', 'request_id': 'req-a4552403-4f45-4ca3-97e3-cf456eb60803'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.255496 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522866debb894299bd724249975f5dda', 'request_id': 'req-a4552403-4f45-4ca3-97e3-cf456eb60803'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.269548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] The token cache is being invalidate because project 522866debb894299bd724249975f5dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:17.269845 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.270698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.272879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1175/2364] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:17 2022] DELETE /identity/v3/projects/522866debb894299bd724249975f5dda => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:17.276544 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:17.287405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac659b0-fe8c-453a-8c9a-4413a748ae62 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:17.360149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:17.361021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:17.361270 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:17.361528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] PATH_INFO: `/v3/users/eecfba310d544e77a483344bf90779d8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:17.363072 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eecfba310d544e77a483344bf90779d8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:17.365507 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:17.426170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eecfba310d544e77a483344bf90779d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.426937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eecfba310d544e77a483344bf90779d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.427627 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eecfba310d544e77a483344bf90779d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.435959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eecfba310d544e77a483344bf90779d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.446175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c9963bc-b2a5-433f-8b42-fd24e90f526e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eecfba310d544e77a483344bf90779d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:17.449536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:17.470282 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1190/2365] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:17 2022] DELETE /identity/v3/users/eecfba310d544e77a483344bf90779d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:18.001821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.003455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:18.021982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552403-4f45-4ca3-97e3-cf456eb60803 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.028003 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:18.085735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.086409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.086689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.086959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] PATH_INFO: `/v3/projects/fdbd306ce5b94f19a5f241222705b421` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.088115 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbd306ce5b94f19a5f241222705b421)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.090524 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.141074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbd306ce5b94f19a5f241222705b421', 'request_id': 'req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:18.147876 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbd306ce5b94f19a5f241222705b421', 'request_id': 'req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:18.156631 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbd306ce5b94f19a5f241222705b421', 'request_id': 'req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:18.172516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] The token cache is being invalidate because project fdbd306ce5b94f19a5f241222705b421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:18.172804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:18.173453 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27f31b5c-1e04-4b84-b21e-bd5c5a4ba65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:18.174947 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1176/2366] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:18 2022] DELETE /identity/v3/projects/fdbd306ce5b94f19a5f241222705b421 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:18.180567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.181043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.181143 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.201356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:18.202535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:18.262726 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1191/2367] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:18.270423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.270709 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.271069 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.291411 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:18.293231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:18.301096 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1177/2368] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:18.305239 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.315109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e2476-c6ac-48e2-945a-79feb2df5f7c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.319587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.320215 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.320496 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.320760 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.321394 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:18.321686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.323463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.335766 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1192/2369] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:18.341130 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.350215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3a3a-313c-4754-aa38-aabdeb8b4204 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.356085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.356677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.356959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.357225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.357852 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.359796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.389078 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1178/2370] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:18.393212 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.403720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f7bed-2014-4a8f-a7f5-f52c3c8e7d39 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.459983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.460576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.460856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.461125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.461754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.463659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.484959 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1193/2371] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:18.489184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.501427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ad93-0a6f-46fb-9e7f-0d26f7304bed admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.506029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.506617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.506928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.507165 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.507802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.509459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.519229 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1179/2372] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:18.523098 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.532988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31161d9b-62f9-423f-81bd-44ff6317d8cc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.537569 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.538149 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.538429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.538695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.539323 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.540942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0132a-aa21-4655-8b9d-f3a8f1d96032 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.552531 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1194/2373] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:18.555925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.566826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194f4d8-b1ad-414d-b55c-99ac3f0eb17a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.571533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.572215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.572497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.572820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] PATH_INFO: `/v3/projects/e928e7b07d19423c9ced832dc6f7c106/users/8c2c33bb58fe4c9aaac3cac5613a2196/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.588037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e928e7b07d19423c9ced832dc6f7c106, user_id=8c2c33bb58fe4c9aaac3cac5613a2196, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.591024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.607922 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1180/2374] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:18 2022] PUT /identity/v3/projects/e928e7b07d19423c9ced832dc6f7c106/users/8c2c33bb58fe4c9aaac3cac5613a2196/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:18.616456 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.616746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.617010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.647043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] MFA Rules not processed for user `8c2c33bb58fe4c9aaac3cac5613a2196`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:18.648452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:18.685382 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:18.722871 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1195/2375] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:18.727366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.765689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:18.798336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b1e8-6fe0-427d-a4f4-50cddf25ba2f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.803189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.803796 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.804127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.804399 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.805038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.806939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.841037 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1181/2376] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:18.845165 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.856758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec353a-5c5b-42b3-b0fa-f26d6fed325a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.914387 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.914916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.915198 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.915473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.916139 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.918782 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.940163 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1196/2377] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:18 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:18.944216 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.956265 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14ab8e-0c33-4cd3-8db6-b3d9c7f4e082 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.961308 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.961913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.962194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.962475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:18.963113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:18.965275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:18.976813 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1182/2378] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:18.981826 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:18.992724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fe5c-aa74-47ec-9167-da82de1e0a01 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:18.998262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:18.998910 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:18.999186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:18.999453 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] PATH_INFO: `/v3/projects/0bc1340045674a05a8b5b56f8671f182/users/6f6cb04851c74b75a9207dab0647d61a/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.015231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1340045674a05a8b5b56f8671f182, user_id=6f6cb04851c74b75a9207dab0647d61a, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.017937 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.031636 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1197/2379] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:18 2022] PUT /identity/v3/projects/0bc1340045674a05a8b5b56f8671f182/users/6f6cb04851c74b75a9207dab0647d61a/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:19.035642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:19.046523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1871-7f23-478c-9a4b-79f7346075b5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:19.101898 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:19.102581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.102866 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.103166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.104626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.106246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab2e94-5f2e-498a-adad-f01d85fa22a6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.115958 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1183/2380] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:19.120301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:19.131216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a3e7-d81b-476b-aa28-4c0c88464f1f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:19.136870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:19.137511 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.137788 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.138059 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] PATH_INFO: `/v3/projects/0bc1340045674a05a8b5b56f8671f182/users/6f6cb04851c74b75a9207dab0647d61a/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.140012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1340045674a05a8b5b56f8671f182, user_id=6f6cb04851c74b75a9207dab0647d61a, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.142635 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.153454 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1198/2381] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:19 2022] PUT /identity/v3/projects/0bc1340045674a05a8b5b56f8671f182/users/6f6cb04851c74b75a9207dab0647d61a/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:19.163666 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.163995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.164275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.191761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] MFA Rules not processed for user `6f6cb04851c74b75a9207dab0647d61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:19.192951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:19.262035 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1184/2382] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:19.273315 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:19.275044 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:19.334327 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32eb4e-d82a-4a8b-8802-42e782c9bd40 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:19.337930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:19.339617 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.339987 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.340258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.349124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.350585 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.360135 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1199/2383] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:19.435478 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:19.444971 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc57d4-e413-40eb-97be-c2b4b0443ffe None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:19.449007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:19.449594 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.449871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.450140 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.476143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:19.506998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.508467 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c14c9-8d70-4b88-9722-c5b6b5598e7e service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.517539 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1185/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:19.878709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:19.878709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:19.912391 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:19.943181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941a62-28fa-4b1e-8e96-798f89ec2000 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:19.947565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:19.948738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:19.949007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:19.949266 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] PATH_INFO: `/v3/users/20fb9b534a4e4961855b826edbcf7e82` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:19.950357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fb9b534a4e4961855b826edbcf7e82)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:19.952296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:19.997917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fb9b534a4e4961855b826edbcf7e82'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:19.998571 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fb9b534a4e4961855b826edbcf7e82'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:19.999178 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fb9b534a4e4961855b826edbcf7e82'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.013040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fb9b534a4e4961855b826edbcf7e82'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.021904 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fb9b534a4e4961855b826edbcf7e82'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.039930 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1200/2385] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:19 2022] DELETE /identity/v3/users/20fb9b534a4e4961855b826edbcf7e82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:20.044414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.044875 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.044984 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.065036 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:20.066269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.126893 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1186/2386] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:20.136988 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.138378 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.194844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6395-37c5-46c9-8493-164c9b623e55 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.199000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.199596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.199888 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.200162 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.208921 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.210341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ec84-b488-4b3a-b4c4-fe60b3dca35c service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.220488 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1201/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:20.487369 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.488815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.501049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a08be7-2ae7-4c77-a737-64ca284452bf None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.505686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.506600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.507001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.507272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] PATH_INFO: `/v3/projects/a58e669febcd49499c300594920ba37a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.508810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58e669febcd49499c300594920ba37a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.510938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.557464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58e669febcd49499c300594920ba37a', 'request_id': 'req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.563074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58e669febcd49499c300594920ba37a', 'request_id': 'req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.569401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58e669febcd49499c300594920ba37a', 'request_id': 'req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.582054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] The token cache is being invalidate because project a58e669febcd49499c300594920ba37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:20.582361 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.582978 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d3e104de-da4c-4cb3-bf35-d9b501cacf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:20.584490 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1187/2388] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:20 2022] DELETE /identity/v3/projects/a58e669febcd49499c300594920ba37a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:20.590329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.590793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.590908 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.611688 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:20.612950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.666489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:20.683436 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1202/2389] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:20.691423 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.691720 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.692032 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.716794 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:20.718001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.728044 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1188/2390] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:20.733065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.742995 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065406-d9fc-4d49-a793-232b55d1d48d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.748917 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.749529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.749881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.750065 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.750706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:20.751011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.752679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.768940 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1203/2391] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:20.770327 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.781406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8c38-8266-49cc-a950-b1518c54716a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.786353 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.787017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.787364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.787707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.788458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.791040 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.822512 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1189/2392] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:20 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:20.824294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.834804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eef1f-04a4-47ed-8587-031957eeaf85 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.899265 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.900131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.900416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.900696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.901901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.903839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.927681 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1204/2393] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:20 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:20.929137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.939674 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbfdad-fafe-4a62-90fa-82c1d2d79318 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.944334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.944930 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.945209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.945479 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.946123 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.948319 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.958896 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1190/2394] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:20.964532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.975004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288676e-af0d-4a3b-89b5-756b2fb159d8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.980297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.980891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.981170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.981440 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.982080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.983716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f27e-73b1-487f-a461-c84943f93a4c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.995297 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1205/2395] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:20.999991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.012593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f551-1c84-49d9-ab5f-0dc5b996b1d7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.017201 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.017848 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.018127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.018418 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] PATH_INFO: `/v3/projects/9d5d990227374008b3fcfd1e496e8dbc/users/f13c588bfa6d453ea1c2f054e21b26ed/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.028065 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:21.033895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5d990227374008b3fcfd1e496e8dbc, user_id=f13c588bfa6d453ea1c2f054e21b26ed, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.037320 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.053322 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1191/2396] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:20 2022] PUT /identity/v3/projects/9d5d990227374008b3fcfd1e496e8dbc/users/f13c588bfa6d453ea1c2f054e21b26ed/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:21.064872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949185-c410-4337-94d7-3603d275de5b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.065182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949185-c410-4337-94d7-3603d275de5b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.065484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949185-c410-4337-94d7-3603d275de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.095685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5d949185-c410-4337-94d7-3603d275de5b None None] MFA Rules not processed for user `f13c588bfa6d453ea1c2f054e21b26ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:21.097879 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5d949185-c410-4337-94d7-3603d275de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:21.174104 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1206/2397] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:21.178542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.243460 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b79635-d742-4e6c-a931-4760aa2957e9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.248498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.249094 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.249368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.249635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.250277 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.252210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.278503 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1192/2398] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:21.282558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d949185-c410-4337-94d7-3603d275de5b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.293966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d949185-c410-4337-94d7-3603d275de5b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.337942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:21.352170 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.352766 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.353045 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.353314 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.354579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.356806 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.378053 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1207/2399] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:21 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:21.382143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.392974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6a6b-02a6-43be-9a1d-f85e46fa13c0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.397542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.398174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.398448 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.398715 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.399346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.401694 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.412337 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1193/2400] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:21.416336 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.426565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b941a-2e9a-49e6-a20a-a9dd848e5628 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.431367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.432113 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.432576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.432846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] PATH_INFO: `/v3/projects/db473f25ec77475ca1580055a89ff219/users/34f99b7f80e645c99edb374cbdb85b14/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.449628 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db473f25ec77475ca1580055a89ff219, user_id=34f99b7f80e645c99edb374cbdb85b14, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.452406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.465584 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1208/2401] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:21 2022] PUT /identity/v3/projects/db473f25ec77475ca1580055a89ff219/users/34f99b7f80e645c99edb374cbdb85b14/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:21.469820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.480458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47970148-baa1-4d90-aaec-73fc72049e8b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.538119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.538718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.538998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.539273 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.539962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.541591 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab3fc-9854-465f-9494-ea3f1e31892c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.551194 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1194/2402] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:21.555500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.565595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd657-52fa-44c7-b061-42f18707ca47 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.570192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.570824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.571100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.571371 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] PATH_INFO: `/v3/projects/db473f25ec77475ca1580055a89ff219/users/34f99b7f80e645c99edb374cbdb85b14/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.573801 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=db473f25ec77475ca1580055a89ff219, user_id=34f99b7f80e645c99edb374cbdb85b14, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.576433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.586271 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1209/2403] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:21 2022] PUT /identity/v3/projects/db473f25ec77475ca1580055a89ff219/users/34f99b7f80e645c99edb374cbdb85b14/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:21.598132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.598414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.598686 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.628393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] MFA Rules not processed for user `34f99b7f80e645c99edb374cbdb85b14`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:21.629603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:21.675103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:21.699804 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1195/2404] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:21.711975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:21.714490 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:21.771234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5eca6-7d7d-49db-bf1d-6226decb0eae admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.774821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.775400 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.775673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.776364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.786749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.788219 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.798010 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1210/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:22.113646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.123500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718b183-a1ca-4641-bea6-681b210ed70f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.128133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f99b7f80e645c99edb374cbdb85b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db473f25ec77475ca1580055a89ff219', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.128728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.129021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.129299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.129945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:22.130256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.131882 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.143128 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1196/2406] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:22.147180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.156304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd198f0-ec30-4da5-9b56-13d071874f54 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.161114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f99b7f80e645c99edb374cbdb85b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db473f25ec77475ca1580055a89ff219', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.161700 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.161980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.162234 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.162894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.164835 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.210899 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1211/2407] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:22 2022] POST /identity/v3/projects => generated 353 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:22.212955 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.223413 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be636-a07b-4a3f-9f4c-8812208779e7 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.284313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.285973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.286713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f99b7f80e645c99edb374cbdb85b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db473f25ec77475ca1580055a89ff219', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.287388 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.287733 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.288044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.288687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:22.288991 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.290576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.309335 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1197/2408] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:22.351426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.358037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc997d-be53-40e3-be83-a7125bf6417f tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.363133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02390-aaac-4080-b18c-2a761445c7b9 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.363679 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.364632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.365010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.365292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] PATH_INFO: `/v3/users/8c2c33bb58fe4c9aaac3cac5613a2196` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.366930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2c33bb58fe4c9aaac3cac5613a2196)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.369164 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f99b7f80e645c99edb374cbdb85b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db473f25ec77475ca1580055a89ff219', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.370488 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.371121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.371244 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.371497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] PATH_INFO: `/v3/projects/b15f40cb01994d969fa14e0424faca6a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.372654 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b15f40cb01994d969fa14e0424faca6a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.374541 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.394086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:22.422437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2c33bb58fe4c9aaac3cac5613a2196'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.423107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2c33bb58fe4c9aaac3cac5613a2196'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.423740 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2c33bb58fe4c9aaac3cac5613a2196'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.424854 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15f40cb01994d969fa14e0424faca6a', 'request_id': 'req-18e76d42-a313-4570-9dde-743d64603db8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.431048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15f40cb01994d969fa14e0424faca6a', 'request_id': 'req-18e76d42-a313-4570-9dde-743d64603db8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.431587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2c33bb58fe4c9aaac3cac5613a2196'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.438553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15f40cb01994d969fa14e0424faca6a', 'request_id': 'req-18e76d42-a313-4570-9dde-743d64603db8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.439452 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2c33bb58fe4c9aaac3cac5613a2196'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.451283 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] The token cache is being invalidate because project b15f40cb01994d969fa14e0424faca6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:22.451639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.452392 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-18e76d42-a313-4570-9dde-743d64603db8 tempest-VolumeQuotaClassesTest-96174528 tempest-VolumeQuotaClassesTest-96174528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.454000 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1198/2409] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:22 2022] DELETE /identity/v3/projects/b15f40cb01994d969fa14e0424faca6a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:22.457720 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1212/2410] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:22 2022] DELETE /identity/v3/users/8c2c33bb58fe4c9aaac3cac5613a2196 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:22.461835 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.462287 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.462559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.482612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:22.483828 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.528498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:22.552205 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1199/2411] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:22.562375 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.563830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.632273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5732b-ddee-4691-bcf2-34e0c53f8b91 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.636749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.637385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.637693 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.637997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.650588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.652830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b033c-94e3-4e15-b4b6-95a7b9318f1e service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.662598 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1213/2412] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:22.664178 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.665509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.677996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536fccb-bff4-45f4-9d09-942872f83f19 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.682611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.683224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.683492 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.683753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] PATH_INFO: `/v3/users/f13c588bfa6d453ea1c2f054e21b26ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.684906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13c588bfa6d453ea1c2f054e21b26ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.687119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.737795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13c588bfa6d453ea1c2f054e21b26ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.738455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13c588bfa6d453ea1c2f054e21b26ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.746404 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13c588bfa6d453ea1c2f054e21b26ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.758800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13c588bfa6d453ea1c2f054e21b26ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.759534 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13c588bfa6d453ea1c2f054e21b26ed'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:22.772810 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1200/2413] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:22 2022] DELETE /identity/v3/users/f13c588bfa6d453ea1c2f054e21b26ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:22.777675 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.778182 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.778274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.798158 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:22.799433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.860915 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1214/2414] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:22.871512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.872931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.932849 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeabe5-0818-4f08-8fd1-9ab58c626b4c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.936535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.937142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.937416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.937687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.940397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:22.941982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:22.949846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.951294 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:22.961480 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1201/2415] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:22.964876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b270f4b-0b12-46af-8f7d-662d12681a6a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:22.970066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:22.970704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:22.971565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:22.971565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] PATH_INFO: `/v3/projects/e928e7b07d19423c9ced832dc6f7c106` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:22.978773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e928e7b07d19423c9ced832dc6f7c106)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:22.980841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.024735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:23.034804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e928e7b07d19423c9ced832dc6f7c106', 'request_id': 'req-7a982e8a-f722-4727-a095-0369b8d2682e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.041009 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e928e7b07d19423c9ced832dc6f7c106', 'request_id': 'req-7a982e8a-f722-4727-a095-0369b8d2682e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.047994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e928e7b07d19423c9ced832dc6f7c106', 'request_id': 'req-7a982e8a-f722-4727-a095-0369b8d2682e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.061334 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] The token cache is being invalidate because project e928e7b07d19423c9ced832dc6f7c106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:23.061620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.062446 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.064131 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1215/2416] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:22 2022] DELETE /identity/v3/projects/e928e7b07d19423c9ced832dc6f7c106 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:23.068167 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.079045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3bf75-54f5-4fba-b22c-31a731c8171b service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.142409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.143073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.143334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.143603 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] PATH_INFO: `/v3/users/6f6cb04851c74b75a9207dab0647d61a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.144775 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6cb04851c74b75a9207dab0647d61a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.146713 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.149162 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:23.196501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6cb04851c74b75a9207dab0647d61a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.197440 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6cb04851c74b75a9207dab0647d61a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.205481 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6cb04851c74b75a9207dab0647d61a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.220033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6cb04851c74b75a9207dab0647d61a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.220787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6cb04851c74b75a9207dab0647d61a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.238072 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1202/2417] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:23 2022] DELETE /identity/v3/users/6f6cb04851c74b75a9207dab0647d61a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:23.258233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.259797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.272855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a982e8a-f722-4727-a095-0369b8d2682e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.337906 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.339137 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.339553 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.339830 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] PATH_INFO: `/v3/projects/9d5d990227374008b3fcfd1e496e8dbc` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.341027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5d990227374008b3fcfd1e496e8dbc)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.342936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.395480 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5d990227374008b3fcfd1e496e8dbc', 'request_id': 'req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.401458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5d990227374008b3fcfd1e496e8dbc', 'request_id': 'req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.411011 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5d990227374008b3fcfd1e496e8dbc', 'request_id': 'req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.425061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] The token cache is being invalidate because project 9d5d990227374008b3fcfd1e496e8dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:23.425356 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.425953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.427455 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1216/2418] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:23 2022] DELETE /identity/v3/projects/9d5d990227374008b3fcfd1e496e8dbc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:23.431371 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.433718 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.446699 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eabcb-9ba9-49d5-bb49-bd22e23b611a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.508951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.509584 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.509861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.510156 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] PATH_INFO: `/v3/users/34f99b7f80e645c99edb374cbdb85b14` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.511841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f99b7f80e645c99edb374cbdb85b14)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.513890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.544606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.546568 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.561041 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a2e-60c8-4cf3-ba48-8cdb09fa3708 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.565891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.566580 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.566861 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.567135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] PATH_INFO: `/v3/projects/0bc1340045674a05a8b5b56f8671f182` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.568541 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc1340045674a05a8b5b56f8671f182)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.570264 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.571084 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f99b7f80e645c99edb374cbdb85b14'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.571746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f99b7f80e645c99edb374cbdb85b14'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.581466 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f99b7f80e645c99edb374cbdb85b14'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.594070 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f99b7f80e645c99edb374cbdb85b14'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.594745 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f3fc7939-1130-46f7-a19e-1e9da7d72233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f99b7f80e645c99edb374cbdb85b14'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.605179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:23.619494 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1203/2419] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:23 2022] DELETE /identity/v3/users/34f99b7f80e645c99edb374cbdb85b14 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:23.629439 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc1340045674a05a8b5b56f8671f182', 'request_id': 'req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.632119 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:23.638144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc1340045674a05a8b5b56f8671f182', 'request_id': 'req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.648201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc1340045674a05a8b5b56f8671f182', 'request_id': 'req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.666259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] The token cache is being invalidate because project 0bc1340045674a05a8b5b56f8671f182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:23.667130 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.668080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c7acfce6-3f5b-4c85-8632-47fd9a252e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:23.670119 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1217/2420] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:23 2022] DELETE /identity/v3/projects/0bc1340045674a05a8b5b56f8671f182 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:23.674993 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.675295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.675572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.697434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:23.699328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.762483 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1204/2421] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:23.770347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.770637 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.770913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.792276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:23.793524 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.801567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1218/2422] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:23.805890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.816211 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6261b6-2f3f-448d-a9a0-6fb4fbd9a531 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.821354 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.821974 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.822256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.822529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.823384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:23.823685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.825365 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.837422 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1205/2423] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:23.842005 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.854650 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50909f8-a7ec-46e7-85b3-b7db738da3be None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.861104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.861836 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.862296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.862699 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.863547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.865492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.909780 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1219/2424] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:23 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:23.914883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.915144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.918153 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.937366 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3659-3041-48ac-b5eb-91b980e6e55a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.984528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25dc7-c6dc-40dc-8dc8-d72d5da1a3b5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.989209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.989805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.990084 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.990350 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.990966 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.992924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.008420 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.009142 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.009416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.009748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] PATH_INFO: `/v3/projects/db473f25ec77475ca1580055a89ff219` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.011535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=db473f25ec77475ca1580055a89ff219)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.015073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.021409 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1220/2425] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:23 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:24.025403 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.035777 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e74f-cd22-4f3e-bcc7-080c556a0b36 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.040818 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.041450 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.042353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.042719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.043355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.044991 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.056053 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1221/2426] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:24.060518 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.070384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7320e-cf75-4f53-9ca3-1655c807a612 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.075195 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db473f25ec77475ca1580055a89ff219', 'request_id': 'req-16e2714a-8fa4-4db9-b915-731802166fad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:24.080736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db473f25ec77475ca1580055a89ff219', 'request_id': 'req-16e2714a-8fa4-4db9-b915-731802166fad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:24.087445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db473f25ec77475ca1580055a89ff219', 'request_id': 'req-16e2714a-8fa4-4db9-b915-731802166fad'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:24.104522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] The token cache is being invalidate because project db473f25ec77475ca1580055a89ff219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:24.105374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:24.106016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16e2714a-8fa4-4db9-b915-731802166fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:24.107500 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1206/2427] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:23 2022] DELETE /identity/v3/projects/db473f25ec77475ca1580055a89ff219 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:24.112207 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bca2cf-7ad8-4f37-b51c-303b3f5513e9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.112486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bca2cf-7ad8-4f37-b51c-303b3f5513e9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.112759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bca2cf-7ad8-4f37-b51c-303b3f5513e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.132133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-41bca2cf-7ad8-4f37-b51c-303b3f5513e9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:24.132674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.133274 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.133409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-41bca2cf-7ad8-4f37-b51c-303b3f5513e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.133583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.133819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.134448 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.136100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.141673 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1207/2428] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:24.146096 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1222/2429] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:24.149149 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.149655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.149743 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.150022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.152703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.164867 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa536-324a-458a-9de9-8a9fe798b3e3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.169824 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:24.170076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.170720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.170994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.171117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.171263 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] PATH_INFO: `/v3/projects/0d3ed0edf6c044549f032b95a056978c/users/1aa55af5181e4faea147f96838772ef3/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.179561 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1208/2430] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:24.183801 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.186950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3ed0edf6c044549f032b95a056978c, user_id=1aa55af5181e4faea147f96838772ef3, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.189144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.190010 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bf11b-e1f5-4855-8d21-538879096024 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.193083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c3d0-ed20-4b13-954c-48a43d209144 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.201560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.202437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.202934 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.203458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.204352 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:24.204657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.205243 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1223/2431] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:24 2022] PUT /identity/v3/projects/0d3ed0edf6c044549f032b95a056978c/users/1aa55af5181e4faea147f96838772ef3/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:24.206437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.217338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.217620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.217890 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.223736 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1209/2432] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:49:24.224708 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.225194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.236169 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb33b81-715e-444d-a5b9-aea4da53ad11 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.249308 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] MFA Rules not processed for user `1aa55af5181e4faea147f96838772ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:24.250515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.295622 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.296261 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.296532 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.296839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.297429 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.299335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.332225 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1210/2433] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:24.333613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.337122 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1224/2434] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:24.355985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.367668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee013e-6e1f-4039-9b00-13fa1bc87245 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.402559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b1e8e-bd45-44d4-9764-4dd291066d12 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.407332 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.408064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.408190 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.408406 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.409037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.411139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.427346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.428004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.428413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.428673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.429326 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.431252 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.437475 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1211/2435] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:24.438539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.448119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004191c-c7b6-4e56-a737-11f194b79883 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.453776 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.454364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.454637 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.454902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.455529 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.457152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.460390 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1225/2436] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:24.463940 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.470541 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1212/2437] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:24.474210 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.484439 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7f26-0dda-4c68-af42-e5d3b3d79d2e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.530180 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726fd6-7f26-4f67-b213-bcabdd39c1f3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.534963 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.535560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.535691 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.535845 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.536162 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.536975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.539201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.544045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.545042 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.545325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.545597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.546238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.547826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.558571 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1213/2438] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:24.565087 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1226/2439] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:24.565236 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.566370 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.572963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7c17-e747-42ea-9aca-cde085aae64c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.576293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a36185-c028-42ce-a254-a2d6f52310ea admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.577669 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.578336 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.578616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.578890 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] PATH_INFO: `/v3/projects/07ecf5b69aaf4ca09ad859ab0f1d6a36/users/1ac98852240948359e71253f86eea29c/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.581135 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.582540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.582839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.583115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.583763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.585384 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.586668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.594428 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ecf5b69aaf4ca09ad859ab0f1d6a36, user_id=1ac98852240948359e71253f86eea29c, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.597120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfd7c6-5d3b-4270-aab9-1396594613c9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.598549 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1227/2440] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:24.602866 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.618307 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1214/2441] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:24 2022] PUT /identity/v3/projects/07ecf5b69aaf4ca09ad859ab0f1d6a36/users/1ac98852240948359e71253f86eea29c/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:24.618952 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846799-a6f9-43ea-b9e7-b7e7d4be5d1a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.629614 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.629894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.630163 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.657736 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] MFA Rules not processed for user `1ac98852240948359e71253f86eea29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:24.659023 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.680655 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.681437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.681710 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.682048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] PATH_INFO: `/v3/projects/b6e659e233914144b2a551c32074baa7/users/735334376be64d0a80029363a4571d80/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.696482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e659e233914144b2a551c32074baa7, user_id=735334376be64d0a80029363a4571d80, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.699716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.713183 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1228/2442] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:24 2022] PUT /identity/v3/projects/b6e659e233914144b2a551c32074baa7/users/735334376be64d0a80029363a4571d80/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:24.717279 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.730806 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1215/2443] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:24.742272 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.744248 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.784755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf493a-2646-4f2c-bc0d-15a0fcd265fb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.791432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.793463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.794190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.794190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.794721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.796595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.807938 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1229/2444] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:24.811809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.812049 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355c86-52d5-43f6-a722-d293f32539d2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.821994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80cffe-8b75-456a-ab60-fe767e1aa7e3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:24.826812 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.827464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.827721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.828026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] PATH_INFO: `/v3/projects/b6e659e233914144b2a551c32074baa7/users/735334376be64d0a80029363a4571d80/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.829945 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e659e233914144b2a551c32074baa7, user_id=735334376be64d0a80029363a4571d80, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.832608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5226-cb61-4e94-8966-ebd3c90312e1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.844714 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1230/2445] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:24 2022] PUT /identity/v3/projects/b6e659e233914144b2a551c32074baa7/users/735334376be64d0a80029363a4571d80/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:24.855514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.855796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.856097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.865174 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:24.865772 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.866045 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.866434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:24.886357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] MFA Rules not processed for user `735334376be64d0a80029363a4571d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:24.887944 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.895009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.928214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:24.929580 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:24.938749 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1216/2446] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:24.940477 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:24.964306 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1231/2447] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:24.974892 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:24.976437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:24.988804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6c833-7764-4f97-9d6a-3ad7b0080515 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:25.043362 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:25.044031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:25.044311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:25.044581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.054028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:25.055518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:25.065417 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1217/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:25.122380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:25.133589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fbf02-e1f6-460a-ac6f-b5f830ead89f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:25.138338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:25.138975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:25.139271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:25.139555 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.210194 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:25.211748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39fce-34f9-4e5b-982c-4a51b0e4c7cc service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:25.222245 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1232/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:28.516829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:28.579789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc365-c438-4f08-9149-2dfb868ad834 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:28.584135 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:28.584740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:28.585013 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:28.585280 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] PATH_INFO: `/v3/users/1aa55af5181e4faea147f96838772ef3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:28.586364 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa55af5181e4faea147f96838772ef3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:28.588931 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:28.637570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa55af5181e4faea147f96838772ef3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:28.638203 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa55af5181e4faea147f96838772ef3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:28.645197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa55af5181e4faea147f96838772ef3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:28.658119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa55af5181e4faea147f96838772ef3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:28.658791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa55af5181e4faea147f96838772ef3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:28.660087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:28.673978 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1218/2450] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:28 2022] DELETE /identity/v3/users/1aa55af5181e4faea147f96838772ef3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:28.678498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:28.678976 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:28.679184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:28.698622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:28.699820 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:28.768888 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1233/2451] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:28.779996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:28.781766 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:28.851279 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375e9b-b5a0-467e-bfab-a234f96df057 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:28.855648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:28.856303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:28.856581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:28.856851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:28.866345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:28.867829 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:28.879172 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1219/2452] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:29.170123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:29.172107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:29.184292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbae77-0520-4c27-a440-a028957f1970 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:29.191829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:29.192674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:29.193090 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:29.193429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] PATH_INFO: `/v3/projects/0d3ed0edf6c044549f032b95a056978c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:29.194790 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3ed0edf6c044549f032b95a056978c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:29.197407 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:29.261872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3ed0edf6c044549f032b95a056978c', 'request_id': 'req-f77dcdba-92e7-4d00-953f-b7327141bb61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.267539 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3ed0edf6c044549f032b95a056978c', 'request_id': 'req-f77dcdba-92e7-4d00-953f-b7327141bb61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.273942 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3ed0edf6c044549f032b95a056978c', 'request_id': 'req-f77dcdba-92e7-4d00-953f-b7327141bb61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.286839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] The token cache is being invalidate because project 0d3ed0edf6c044549f032b95a056978c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:29.287122 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.287734 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.289252 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1234/2453] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:29 2022] DELETE /identity/v3/projects/0d3ed0edf6c044549f032b95a056978c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:29.293756 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:29.304470 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906b82-6386-4cd7-9b78-469f332e740c service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:29.363213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:29.363754 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:29.364064 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:29.364329 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] PATH_INFO: `/v3/users/735334376be64d0a80029363a4571d80` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:29.365533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735334376be64d0a80029363a4571d80)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:29.367748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:29.414707 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735334376be64d0a80029363a4571d80'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.415341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735334376be64d0a80029363a4571d80'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.423381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735334376be64d0a80029363a4571d80'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.435670 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735334376be64d0a80029363a4571d80'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.436311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1018b974-94c3-41a5-8f62-27b1cfe14639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735334376be64d0a80029363a4571d80'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.448938 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1220/2454] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:29 2022] DELETE /identity/v3/users/735334376be64d0a80029363a4571d80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:29.740803 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:29.742398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:29.759485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dcdba-92e7-4d00-953f-b7327141bb61 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:29.765674 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:29.820376 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:29.820990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:29.821269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:29.821535 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] PATH_INFO: `/v3/projects/b6e659e233914144b2a551c32074baa7` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:29.822666 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e659e233914144b2a551c32074baa7)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:29.825104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:29.873096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e659e233914144b2a551c32074baa7', 'request_id': 'req-3231b1b1-f5f3-4650-979d-8da02108fa53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.878754 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e659e233914144b2a551c32074baa7', 'request_id': 'req-3231b1b1-f5f3-4650-979d-8da02108fa53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.885517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e659e233914144b2a551c32074baa7', 'request_id': 'req-3231b1b1-f5f3-4650-979d-8da02108fa53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.897672 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] The token cache is being invalidate because project b6e659e233914144b2a551c32074baa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:29.897959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.898583 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3231b1b1-f5f3-4650-979d-8da02108fa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:29.900310 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1235/2455] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:29 2022] DELETE /identity/v3/projects/b6e659e233914144b2a551c32074baa7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:29.905446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:29.905944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:29.906060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:29.926376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:29.927570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:29.933239 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:29.987807 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1221/2456] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:29.997474 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:29.997763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:29.998043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.018714 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:30.019991 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:30.028035 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1236/2457] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:30.032351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.042143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731e0c-4d44-4b84-be17-d182753ade2d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.046677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.047269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.047554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.047823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.048497 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:30.048795 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.050391 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.062549 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1222/2458] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:30.066730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.077039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582dc6-ba1d-4b00-a326-f151de741822 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.081593 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.082187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.082454 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.082721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.083340 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.085273 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.122463 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1237/2459] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:30.126833 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.136724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7151e-ca9a-4050-ae56-3533c22e05db admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.193416 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.194155 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.194556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.194944 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.195667 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.197832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.219743 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1223/2460] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:30.222924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.234052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b703d-8528-4c6d-a4f2-205c23ac07ee admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.238876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.239461 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.239738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.240062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.240702 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.242333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.252958 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1238/2461] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:30.256939 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.267334 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6e51-e0ed-46db-b8ce-b0bce9722eba admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.271921 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.272512 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.272785 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.273051 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.273746 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.275259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439d30-be4e-4a66-8231-cdef4840308f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.287678 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1224/2462] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:30.292634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.302612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3acb-a2fd-418f-a679-86444db9e0c4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.307230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.308196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.308473 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.308743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] PATH_INFO: `/v3/projects/21bbdf82d49f416c8682e7badcdb1e22/users/7494028629d945608480f2bc5b338dd9/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.325245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bbdf82d49f416c8682e7badcdb1e22, user_id=7494028629d945608480f2bc5b338dd9, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.328410 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.342256 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1239/2463] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:30 2022] PUT /identity/v3/projects/21bbdf82d49f416c8682e7badcdb1e22/users/7494028629d945608480f2bc5b338dd9/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:30.352655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.352936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.353196 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.384982 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] MFA Rules not processed for user `7494028629d945608480f2bc5b338dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:30.386721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:30.454425 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1225/2464] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:30.459196 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.495190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:30.535558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db706-0ad7-47ca-862a-19cdc4f7a27b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.540981 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.542259 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.543131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.543495 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.544166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.546066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.583221 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1240/2465] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:30.587493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.599132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cc358-6ed0-48ee-aeb0-d6702b0ce8cc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.603024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:30.681458 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.682158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.682450 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.683012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.683742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.685813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.706838 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1226/2466] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:30.710949 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.721632 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f23ae-f547-4ad2-84f2-ea850b2aa74d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.726226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.726852 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.727133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.727402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.728068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.729810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.740300 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1241/2467] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:30.744183 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.754914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff18-e027-40f0-b4d1-13a07fbff5b4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.759482 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.760778 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.761092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.761255 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.761894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.763553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fa82-306b-468a-a3aa-6a14264f8a1a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.773409 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1227/2468] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:30.777804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:30.787484 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f402d-7422-4eb9-870d-0b04caf2390a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:30.792257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:30.792884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.793284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.793420 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] PATH_INFO: `/v3/projects/9b0cec4a3407405495f3c259f9a9056d/users/77e53c40eda44e948176fc4ce4b6d203/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.808705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0cec4a3407405495f3c259f9a9056d, user_id=77e53c40eda44e948176fc4ce4b6d203, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:30.811339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:30.824925 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1242/2469] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:30 2022] PUT /identity/v3/projects/9b0cec4a3407405495f3c259f9a9056d/users/77e53c40eda44e948176fc4ce4b6d203/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:30.834938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:30.835323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:30.835664 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:30.864663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] MFA Rules not processed for user `77e53c40eda44e948176fc4ce4b6d203`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:30.865858 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:30.938641 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1228/2470] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:30.939592 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.004525 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870b60-b63c-4cf0-88a5-f25edf81082d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.009533 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.010258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.011082 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.011381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.012062 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.014000 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.057885 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1243/2471] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:30 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:31.062262 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.073232 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9f219-2a13-4adc-83fc-9d9ae1ed4af5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.131831 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.133112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.133112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.133112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.133618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.136186 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.157789 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1229/2472] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:31 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:31.161821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.172485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f2dc-3fde-4425-9b91-71e0a658d3fa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.177164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.177753 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.178033 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.178301 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.178936 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.180599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.193238 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1244/2473] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:31.197523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.205106 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:31.209052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1f3c-148e-4053-bdc8-d400bbdf372c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.217530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.218629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.218907 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.219617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] PATH_INFO: `/v3/projects/95adbad350d8436c918b57831bebd63e/users/5870d277feac48fba582692ce1fd0b46/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.237303 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95adbad350d8436c918b57831bebd63e, user_id=5870d277feac48fba582692ce1fd0b46, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.240384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.255909 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1230/2474] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:31 2022] PUT /identity/v3/projects/95adbad350d8436c918b57831bebd63e/users/5870d277feac48fba582692ce1fd0b46/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:31.262280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.273208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224f7f-c303-4dfd-be34-75b885edf865 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.332516 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:31.347150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.347763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.348075 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.348359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.349007 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.350662 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659d634-fa64-4fda-b3b0-b6b02f7ea454 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.360990 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1245/2475] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:31.365755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.381656 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4306-e94a-4425-8717-7539b39bb19c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.386913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.387570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.387874 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.388157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] PATH_INFO: `/v3/projects/95adbad350d8436c918b57831bebd63e/users/5870d277feac48fba582692ce1fd0b46/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.390102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=95adbad350d8436c918b57831bebd63e, user_id=5870d277feac48fba582692ce1fd0b46, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.392872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.403744 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1231/2476] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:31 2022] PUT /identity/v3/projects/95adbad350d8436c918b57831bebd63e/users/5870d277feac48fba582692ce1fd0b46/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:31.471355 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.471579 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.471842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.499946 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] MFA Rules not processed for user `5870d277feac48fba582692ce1fd0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:31.501152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:31.567461 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1246/2477] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:31.580256 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.581951 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:31.642576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03b77-ffeb-43cd-86b2-153fab98a6da admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.646235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.646834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.647110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.647374 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.657024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.658619 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.668789 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1232/2478] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:31.711190 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:31.712590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:31.725965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f610f9-60c3-4d82-8336-ab98f07fdba5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:31.730694 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:31.731271 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:31.731540 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:31.731811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:31.787896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:31.789359 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938bd3b-66c9-4274-992a-ecef20a752f0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:31.798955 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1247/2479] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:34.669309 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:34.730915 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe172e9-31f3-43ed-985d-2a0e567e9400 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:34.735520 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:34.736175 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:34.736451 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:34.736719 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] PATH_INFO: `/v3/users/7494028629d945608480f2bc5b338dd9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:34.737857 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7494028629d945608480f2bc5b338dd9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:34.739832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:34.785879 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7494028629d945608480f2bc5b338dd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:34.786609 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7494028629d945608480f2bc5b338dd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:34.794237 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7494028629d945608480f2bc5b338dd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:34.806161 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7494028629d945608480f2bc5b338dd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:34.806783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7494028629d945608480f2bc5b338dd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:34.808489 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:34.823704 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1233/2480] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:34 2022] DELETE /identity/v3/users/7494028629d945608480f2bc5b338dd9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:34.828176 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:34.828696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:34.828813 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:34.847515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:34.848670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:34.906832 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1248/2481] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:34.917372 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:34.918773 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:34.980108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a5d7-78f3-41a3-aa9c-013e8260149f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:34.984031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:34.984731 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:34.985100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:34.985486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:34.996873 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:34.998299 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:35.008378 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1234/2482] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:35.299055 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:35.300620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:35.318026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9caee-af29-41d5-982c-eab692f25cf5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:35.322850 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:35.323470 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:35.323743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:35.324043 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] PATH_INFO: `/v3/projects/21bbdf82d49f416c8682e7badcdb1e22` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:35.325181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bbdf82d49f416c8682e7badcdb1e22)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:35.327317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:35.334928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:35.383424 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bbdf82d49f416c8682e7badcdb1e22', 'request_id': 'req-9dcad78e-5ab5-4543-bba4-11dfd4587614'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.389167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bbdf82d49f416c8682e7badcdb1e22', 'request_id': 'req-9dcad78e-5ab5-4543-bba4-11dfd4587614'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.396109 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bbdf82d49f416c8682e7badcdb1e22', 'request_id': 'req-9dcad78e-5ab5-4543-bba4-11dfd4587614'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.410984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] The token cache is being invalidate because project 21bbdf82d49f416c8682e7badcdb1e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:35.411276 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.411933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.413465 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1249/2483] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:35 2022] DELETE /identity/v3/projects/21bbdf82d49f416c8682e7badcdb1e22 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:35.419197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:35.435102 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb0ba9-193b-481f-9d18-ecd9ec3c9131 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:35.497145 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:35.497943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:35.498268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:35.498539 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] PATH_INFO: `/v3/users/77e53c40eda44e948176fc4ce4b6d203` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:35.499680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e53c40eda44e948176fc4ce4b6d203)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:35.501702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:35.552112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e53c40eda44e948176fc4ce4b6d203'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.552764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e53c40eda44e948176fc4ce4b6d203'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.560530 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e53c40eda44e948176fc4ce4b6d203'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.572810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e53c40eda44e948176fc4ce4b6d203'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.573477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e53c40eda44e948176fc4ce4b6d203'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:35.586172 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1235/2484] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:35 2022] DELETE /identity/v3/users/77e53c40eda44e948176fc4ce4b6d203 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:35.868106 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:35.870296 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:35.883550 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad78e-5ab5-4543-bba4-11dfd4587614 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:35.945048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:35.945686 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:35.945965 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:35.946236 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] PATH_INFO: `/v3/projects/9b0cec4a3407405495f3c259f9a9056d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:35.948648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0cec4a3407405495f3c259f9a9056d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:35.950761 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.000721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0cec4a3407405495f3c259f9a9056d', 'request_id': 'req-6e970a27-a700-44a7-a1e1-0afe560bb7aa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.006534 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0cec4a3407405495f3c259f9a9056d', 'request_id': 'req-6e970a27-a700-44a7-a1e1-0afe560bb7aa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.013543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0cec4a3407405495f3c259f9a9056d', 'request_id': 'req-6e970a27-a700-44a7-a1e1-0afe560bb7aa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.026381 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] The token cache is being invalidate because project 9b0cec4a3407405495f3c259f9a9056d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:36.027363 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.028013 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.029710 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1250/2485] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:35 2022] DELETE /identity/v3/projects/9b0cec4a3407405495f3c259f9a9056d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:36.044056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:36.044056 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:36.053103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d320f-f385-4794-8d5f-14024136f323 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:36.061946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:36.115535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:36.116345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.116626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.116894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] PATH_INFO: `/v3/users/5870d277feac48fba582692ce1fd0b46` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.118034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5870d277feac48fba582692ce1fd0b46)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:36.120080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.170906 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5870d277feac48fba582692ce1fd0b46'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.171535 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5870d277feac48fba582692ce1fd0b46'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.178606 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5870d277feac48fba582692ce1fd0b46'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.201491 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5870d277feac48fba582692ce1fd0b46'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.202333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e74766b0-a5db-465b-884c-ccf7cca7cb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5870d277feac48fba582692ce1fd0b46'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.228759 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1236/2486] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:36 2022] DELETE /identity/v3/users/5870d277feac48fba582692ce1fd0b46 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:36.510832 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:36.512405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:36.525560 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970a27-a700-44a7-a1e1-0afe560bb7aa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:36.549744 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:36.590975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:36.591601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.591901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.592171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] PATH_INFO: `/v3/projects/95adbad350d8436c918b57831bebd63e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.593269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=95adbad350d8436c918b57831bebd63e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:36.595210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.648492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95adbad350d8436c918b57831bebd63e', 'request_id': 'req-cb032761-5896-4852-9f36-12f0a6465abd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.654598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95adbad350d8436c918b57831bebd63e', 'request_id': 'req-cb032761-5896-4852-9f36-12f0a6465abd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.660997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95adbad350d8436c918b57831bebd63e', 'request_id': 'req-cb032761-5896-4852-9f36-12f0a6465abd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.673804 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] The token cache is being invalidate because project 95adbad350d8436c918b57831bebd63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:36.674088 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.674719 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cb032761-5896-4852-9f36-12f0a6465abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:36.676232 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1251/2487] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:36 2022] DELETE /identity/v3/projects/95adbad350d8436c918b57831bebd63e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:36.682235 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.682523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.682798 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.702770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:36.703933 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:36.767312 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1237/2488] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:36.775631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.776104 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.776383 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.795924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:36.797140 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:36.804973 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1252/2489] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:36.809919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:36.819662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac39531-e918-4f88-ae2d-9d3bfbac42f4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:36.824998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:36.825595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.825877 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.826692 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.827343 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:36.827648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:36.829377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.841302 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1238/2490] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:36.845558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:36.856347 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4279-37c3-48e0-ae48-235fdf09d624 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:36.861032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:36.861620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.861898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.862167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.862797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:36.864781 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.899563 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1253/2491] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:36 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:36.900894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:36.911593 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba0c4-f19e-4a48-877b-42fc8acbc8c1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:36.924243 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:36.971815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:36.972511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:36.972812 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:36.973085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:36.973769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:36.975789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:36.999449 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1239/2492] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:36 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:37.004703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.015654 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26101-f4b2-4efc-ad2b-cb239babb4cb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.020743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.021357 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.021612 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.021880 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.022859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.024557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.036014 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1254/2493] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:37.040650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.051883 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb048b1-36c1-4a8a-ae15-a193b4a7126f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.058553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.059189 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.059499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.059954 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.060789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.062486 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881808-9774-4720-be58-e20b32410c73 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.074310 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1240/2494] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:37.078423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.088155 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915e45-a040-438f-a76b-ebff87d5499a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.092894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.093517 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.093792 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.094060 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] PATH_INFO: `/v3/projects/2ef5f18917774dd78c10c6e1d1b1db72/users/075dc075d5a440ebb5103b4e85092732/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.109208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef5f18917774dd78c10c6e1d1b1db72, user_id=075dc075d5a440ebb5103b4e85092732, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.111901 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.125354 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1255/2495] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:37 2022] PUT /identity/v3/projects/2ef5f18917774dd78c10c6e1d1b1db72/users/075dc075d5a440ebb5103b4e85092732/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:37.136888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.137292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.137494 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.167091 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] MFA Rules not processed for user `075dc075d5a440ebb5103b4e85092732`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:37.168342 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.231754 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1241/2496] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:37.236324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.290739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:37.304913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24efdab-05c1-4833-8ef7-bedd2de5fd2c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.310172 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.310769 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.311051 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.311320 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.311984 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.313905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.347780 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1256/2497] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:37 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:37.348823 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.356833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.358529 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.365965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4388a7-cf83-406d-b745-c3e13cd53ee6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.436817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.437437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.437797 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.438112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.438752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.441022 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.442001 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46019429-3ae2-4ef8-8c7c-93a06621fc25 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.446918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.447591 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.448133 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.448503 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] PATH_INFO: `/v3/users/2cb777fa264a42ee8c0873c7f2293cde` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.449648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb777fa264a42ee8c0873c7f2293cde)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.452128 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.465601 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1242/2498] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:37 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:37.470230 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.481394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a557a9d-04c5-4001-bac4-cb2ddb5df95b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.486983 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.487560 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.487839 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.488143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.504503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.504503 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.504503 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1243/2499] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:37.506215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.513326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:37.517659 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb777fa264a42ee8c0873c7f2293cde'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:37.517990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be17f-2305-4e7f-bca2-3f21eb041b7e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.518500 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb777fa264a42ee8c0873c7f2293cde'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:37.519254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb777fa264a42ee8c0873c7f2293cde'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:37.523859 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.524626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.524902 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.525241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] PATH_INFO: `/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2/users/5d9779da7eaa4f98afb30d27359b9f3d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.528395 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb777fa264a42ee8c0873c7f2293cde'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:37.536622 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89c6d773-c838-4dc6-912e-41777f8833f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb777fa264a42ee8c0873c7f2293cde'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:37.545805 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f32b4e97d24f199a00c230e4ca9ff2, user_id=5d9779da7eaa4f98afb30d27359b9f3d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.548662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.563834 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1257/2500] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:37 2022] DELETE /identity/v3/users/2cb777fa264a42ee8c0873c7f2293cde => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:37.564826 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1244/2501] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:37 2022] PUT /identity/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2/users/5d9779da7eaa4f98afb30d27359b9f3d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:37.569576 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.569977 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.570432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.570586 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.572382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.598929 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:37.600272 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.657639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8571-4396-4831-8294-854cd9a6c57f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.666489 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:37.684745 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1258/2502] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:37.694428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.695811 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.727350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.728033 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.728315 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.728623 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.729457 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.731516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.743289 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1245/2503] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:37.747920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.757436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e1423-501d-4335-a7ec-7841f5bcbaed admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.757747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b19b-82e1-402b-af36-b7893ff52399 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:37.762042 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.762673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.762953 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.763122 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:37.763262 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.763747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.764058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.764326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] PATH_INFO: `/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2/users/5d9779da7eaa4f98afb30d27359b9f3d/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.766219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f32b4e97d24f199a00c230e4ca9ff2, user_id=5d9779da7eaa4f98afb30d27359b9f3d, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.768871 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806131f-0ee2-4e42-a936-b09e57fb3d84 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.773367 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:37.774841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:37.780159 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1246/2504] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:37 2022] PUT /identity/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2/users/5d9779da7eaa4f98afb30d27359b9f3d/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:37.789146 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1259/2505] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:37.790151 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:37.790500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:37.790832 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:37.821789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] MFA Rules not processed for user `5d9779da7eaa4f98afb30d27359b9f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:37.823644 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.886017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:37.896645 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1247/2506] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:37.909599 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:37.911971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:37.977405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826b1-3f3c-45b4-8868-1f5f104a5680 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.030414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.031018 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.031297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.031566 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.040975 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.042837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.053390 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1260/2507] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:38.074054 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.075587 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.148821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515274d-5ab8-450b-ae94-d8f7b8b46374 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.151676 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.160730 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c3a5-50fa-4697-a31c-4662748ae410 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.161816 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.162523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.162728 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.163016 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] PATH_INFO: `/v3/projects/57d54fe92a8f46d29b670a333be0df06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.164191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d54fe92a8f46d29b670a333be0df06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.165216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.165809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.166119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.166260 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.166428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.168413 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.214046 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d54fe92a8f46d29b670a333be0df06', 'request_id': 'req-c79a9761-f570-4617-9f9c-94d4a719ae48'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.220021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d54fe92a8f46d29b670a333be0df06', 'request_id': 'req-c79a9761-f570-4617-9f9c-94d4a719ae48'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.226345 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d54fe92a8f46d29b670a333be0df06', 'request_id': 'req-c79a9761-f570-4617-9f9c-94d4a719ae48'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.228971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:38.231232 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.232746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42981c3f-f6c4-45b4-9311-a1cebb2b13d4 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.239176 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] The token cache is being invalidate because project 57d54fe92a8f46d29b670a333be0df06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:38.239464 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.240098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c79a9761-f570-4617-9f9c-94d4a719ae48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.241734 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1248/2508] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:38 2022] DELETE /identity/v3/projects/57d54fe92a8f46d29b670a333be0df06 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:38.242791 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1261/2509] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:38.247518 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.247787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.248097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.270511 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:38.271735 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.332852 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1249/2510] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:38.340809 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.341089 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.341353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.361619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:38.362870 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.375165 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1262/2511] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:38.379559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.391194 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad96e1-ec49-43fd-b381-aaf55033f058 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.397385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.398029 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.398495 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.398986 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.399804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:38.400184 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.402311 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.414561 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1250/2512] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:38.419416 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.429257 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f6b1e-91d0-4b49-bbaf-b819011ef981 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.435609 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.436248 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.436528 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.436800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.437445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.439414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.467460 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1263/2513] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:49:38.471679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.486107 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b31f-def0-4083-be8d-99198cec37cb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.491452 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:38.564953 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.565787 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.566079 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.566403 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.567048 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.569055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.595899 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1251/2514] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:38.598563 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.611466 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9926cb-6fa5-4b8b-a721-855f43d9bf67 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.618096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.618807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.619186 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.620136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.621596 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.623100 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.633950 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1264/2515] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:38.637914 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.649888 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0ef9-3991-48ea-ba4c-e989f34d3799 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.655043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.655784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.655975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.656222 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.656856 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.658437 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.659881 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.661997 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.672986 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1252/2516] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:38.677021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.678233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e4c5-c690-4ac3-ab79-481c9ae1481d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.683745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.684409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.684687 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.684960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] PATH_INFO: `/v3/users/1ac98852240948359e71253f86eea29c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.686102 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac98852240948359e71253f86eea29c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.688132 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.689111 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d6f5-47c9-4fb5-9772-5d5d03e94e88 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.693847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.694483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.694765 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.695041 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] PATH_INFO: `/v3/projects/83e3c3a64d5641e0b2c88b019087d4b2/users/5cf5b3e78bc64e7f9f1da0c8e75d55ec/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.710214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e3c3a64d5641e0b2c88b019087d4b2, user_id=5cf5b3e78bc64e7f9f1da0c8e75d55ec, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.713578 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974089f-4804-43d4-99ca-0335e50a5974 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.729614 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1253/2517] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:38 2022] PUT /identity/v3/projects/83e3c3a64d5641e0b2c88b019087d4b2/users/5cf5b3e78bc64e7f9f1da0c8e75d55ec/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:38.738849 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac98852240948359e71253f86eea29c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.739793 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac98852240948359e71253f86eea29c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.740683 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac98852240948359e71253f86eea29c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.741851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.742144 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.742425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.749187 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac98852240948359e71253f86eea29c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.756513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f0067365-0b49-4a52-9d65-028884b6bd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac98852240948359e71253f86eea29c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:38.774232 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1265/2518] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:38 2022] DELETE /identity/v3/users/1ac98852240948359e71253f86eea29c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:38.777507 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] MFA Rules not processed for user `5cf5b3e78bc64e7f9f1da0c8e75d55ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:38.778250 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.778859 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.779144 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.779415 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.799595 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:38.800839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.845997 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1254/2519] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:38.858219 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.859612 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.863687 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1266/2520] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:38.874843 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.876209 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.910630 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:38.918538 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652aa25-04b5-49cc-b220-852afef9f15b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.922525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.923131 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.923409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.923714 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.933073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.934533 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.939083 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:38.941125 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255060f-7a10-4b94-9457-829eeb778bf9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.944316 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1255/2521] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:38.944763 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.945428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.945865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.946171 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.956246 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.957663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26c20-c50e-4f10-8a5e-fabfe6fe9e6c service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.967575 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1267/2522] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:38.973970 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.975396 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.989842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb3fb-ae30-4f77-a7c2-71876e70e836 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.995215 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.995840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.996401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.996672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] PATH_INFO: `/v3/users/5cf5b3e78bc64e7f9f1da0c8e75d55ec` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.997813 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf5b3e78bc64e7f9f1da0c8e75d55ec)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.999810 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.051270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf5b3e78bc64e7f9f1da0c8e75d55ec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.051960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf5b3e78bc64e7f9f1da0c8e75d55ec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.060648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf5b3e78bc64e7f9f1da0c8e75d55ec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.075002 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf5b3e78bc64e7f9f1da0c8e75d55ec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.076172 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf5b3e78bc64e7f9f1da0c8e75d55ec'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.089980 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1256/2523] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:38 2022] DELETE /identity/v3/users/5cf5b3e78bc64e7f9f1da0c8e75d55ec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:39.094620 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.094902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.095220 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.117251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:39.121482 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.186688 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1268/2524] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:39.197247 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.198764 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.261473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e578-6a5c-4d5c-8283-4b9e183c8fb1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.265191 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.265887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.266170 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.266438 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.269058 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.270463 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.279037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.280553 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8dd4-e363-4d0f-8e19-3987157ddc21 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.284227 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849a3f5-521b-4029-95fb-ef9e841156ec None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.291553 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1257/2525] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:39.302567 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a155da-682b-4280-822f-075840313029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.303397 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a155da-682b-4280-822f-075840313029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.303713 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a155da-682b-4280-822f-075840313029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.303982 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a155da-682b-4280-822f-075840313029 admin admin] PATH_INFO: `/v3/projects/07ecf5b69aaf4ca09ad859ab0f1d6a36` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.305188 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a155da-682b-4280-822f-075840313029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ecf5b69aaf4ca09ad859ab0f1d6a36)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.307905 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a155da-682b-4280-822f-075840313029 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.359277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ecf5b69aaf4ca09ad859ab0f1d6a36', 'request_id': 'req-68a155da-682b-4280-822f-075840313029'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.365120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ecf5b69aaf4ca09ad859ab0f1d6a36', 'request_id': 'req-68a155da-682b-4280-822f-075840313029'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.373076 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ecf5b69aaf4ca09ad859ab0f1d6a36', 'request_id': 'req-68a155da-682b-4280-822f-075840313029'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.386235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] The token cache is being invalidate because project 07ecf5b69aaf4ca09ad859ab0f1d6a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:39.386522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.387157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68a155da-682b-4280-822f-075840313029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.388742 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1269/2526] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:39 2022] DELETE /identity/v3/projects/07ecf5b69aaf4ca09ad859ab0f1d6a36 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:39.394887 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.395179 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.395455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.416377 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:39.417581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.481675 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1258/2527] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:39.489652 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.489964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.490233 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.511968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:39.513184 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.521301 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1270/2528] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:39.525547 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.536817 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c612d7-a755-4577-84be-895e7bcda644 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.541610 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.542204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.542477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.542749 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.543389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:39.543689 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.545326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.557090 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1259/2529] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:39.561749 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.571328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f3984-eb32-4f51-8813-62b62e2a9578 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.577530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.578226 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.578469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.578644 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.579269 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.581353 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.585900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.590138 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.601786 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:39.615601 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908447-f15d-4ca4-a4e9-cc1f2ca26ba4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.621471 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.622103 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.622379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.622650 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] PATH_INFO: `/v3/projects/83e3c3a64d5641e0b2c88b019087d4b2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.623820 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e3c3a64d5641e0b2c88b019087d4b2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.625763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.633500 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1271/2530] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:39.638230 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.673796 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:39.686738 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e3c3a64d5641e0b2c88b019087d4b2', 'request_id': 'req-17dedabb-d47e-4722-8b45-1dfc213aefa4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.692611 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e3c3a64d5641e0b2c88b019087d4b2', 'request_id': 'req-17dedabb-d47e-4722-8b45-1dfc213aefa4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.700484 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e3c3a64d5641e0b2c88b019087d4b2', 'request_id': 'req-17dedabb-d47e-4722-8b45-1dfc213aefa4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.716472 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] The token cache is being invalidate because project 83e3c3a64d5641e0b2c88b019087d4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:39.716781 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.717419 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17dedabb-d47e-4722-8b45-1dfc213aefa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.719363 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1260/2531] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:39 2022] DELETE /identity/v3/projects/83e3c3a64d5641e0b2c88b019087d4b2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:39.720037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade557c6-8ed1-4226-ab94-eb2e68480dd0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.724402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db0cd-98b7-4954-a300-4efd5afbdfad None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.724679 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db0cd-98b7-4954-a300-4efd5afbdfad None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.724947 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db0cd-98b7-4954-a300-4efd5afbdfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.748961 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e65db0cd-98b7-4954-a300-4efd5afbdfad None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:39.750442 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e65db0cd-98b7-4954-a300-4efd5afbdfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.795514 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.796300 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.796608 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.796884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.797578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.799562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.816963 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1261/2532] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:39.822149 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1272/2533] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:39.825604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.825895 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.826157 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.826271 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.827918 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.841998 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ee41-2ae8-4a9c-aa82-bd5be4c2d454 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.848137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:39.849017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.849331 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.849634 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.849985 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.850168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.850819 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.852497 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.863899 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1273/2534] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:39.864595 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1262/2535] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:39.867805 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.872348 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.879295 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191fcf-c300-483d-96b5-7ad7f881180b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.882903 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6475ea-a32e-41eb-87b3-77351a20e0c2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.884321 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.885048 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.885992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.886425 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.887251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.888950 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.889800 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.890436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.890680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.890946 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.891648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:39.891968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.893548 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.903220 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1274/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:39.907405 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.910398 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1263/2537] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:49:39.914317 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.920324 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d791-c6d6-46e6-9249-ee333a5acc7e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.924999 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2746c08-f009-48dd-8d89-ad435d11c5db admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.927208 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.927973 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.928258 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.928532 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] PATH_INFO: `/v3/projects/127a6ac413544d8f9d2b06b312c3c245/users/f40f00666dc44510bb05cf09db5dfa0d/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.929725 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.930310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.930607 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.930957 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.931498 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.934221 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.946409 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a6ac413544d8f9d2b06b312c3c245, user_id=f40f00666dc44510bb05cf09db5dfa0d, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.950039 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324b143-6ae1-44a6-8ae9-47368938d8b1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.962239 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1264/2538] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:39.962980 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1275/2539] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:39 2022] PUT /identity/v3/projects/127a6ac413544d8f9d2b06b312c3c245/users/f40f00666dc44510bb05cf09db5dfa0d/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:39.966919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.973115 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.973401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.973716 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.002626 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] MFA Rules not processed for user `f40f00666dc44510bb05cf09db5dfa0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:40.003894 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:40.016510 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:40.035969 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7268e-1de9-4d17-8133-1a7c198792f0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.040638 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.041228 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.041554 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.041822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.042454 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.044397 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.071042 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1265/2540] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:40.072333 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.079951 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1276/2541] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:40.083516 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848f08a-f514-4322-8c5a-05063ebcd520 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.088913 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.090414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.090711 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.090977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.091613 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.092556 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.093225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.093974 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:40.103406 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:40.105379 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1266/2542] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:40.109830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.119197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea95ea-8c73-4e46-871f-736863b3c002 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.124141 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.124716 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.125044 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.125417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.126043 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.127617 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.139741 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1267/2543] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:40.144936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.155338 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ff1-59a7-4dde-8007-8993672086f2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.157493 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f271d8-024f-4b0b-8cb6-3ff710180653 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.160117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.160760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.161017 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.161137 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.161291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] PATH_INFO: `/v3/projects/376ad70dbe0c48b78bffde5a73740c78/users/851aa42f54d44747a40adee8f7276b82/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.161624 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.161884 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.162152 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.170933 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.172390 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d21ea-aa19-40df-a998-4b8f7555b3dc service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.175841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376ad70dbe0c48b78bffde5a73740c78, user_id=851aa42f54d44747a40adee8f7276b82, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.178502 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.181084 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1277/2544] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:40.191741 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1268/2545] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:40 2022] PUT /identity/v3/projects/376ad70dbe0c48b78bffde5a73740c78/users/851aa42f54d44747a40adee8f7276b82/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:40.203891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.204328 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.204668 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.234292 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] MFA Rules not processed for user `851aa42f54d44747a40adee8f7276b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:40.235543 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:40.305876 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1278/2546] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:40.317826 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.319537 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:40.381293 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1608d3-56cc-4de1-97ab-7ef9e50403a3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.384977 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.386092 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.386368 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.386640 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.395341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.396804 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a80d9e-7113-4aa4-8869-ea910c539261 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.406263 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1269/2547] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:43.282034 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:43.283558 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:43.360522 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e4eb-415f-4683-9aaf-5e2ed1a641bf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:43.371451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:43.371451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:43.371451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:43.371451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] PATH_INFO: `/v3/users/075dc075d5a440ebb5103b4e85092732` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:43.371886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=075dc075d5a440ebb5103b4e85092732)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:43.371886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:43.415865 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:43.422020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075dc075d5a440ebb5103b4e85092732'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:43.422856 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075dc075d5a440ebb5103b4e85092732'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:43.423642 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075dc075d5a440ebb5103b4e85092732'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:43.431057 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075dc075d5a440ebb5103b4e85092732'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:43.439587 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075dc075d5a440ebb5103b4e85092732'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:43.457755 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1279/2548] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:43 2022] DELETE /identity/v3/users/075dc075d5a440ebb5103b4e85092732 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:43.462425 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:43.462925 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:43.463030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:43.483647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:43.484885 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:43.543644 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1270/2549] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:43.554298 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:43.555733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:43.615457 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022a99-a4e3-46d3-b594-d232b8ae3cae admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:43.620960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:43.620960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:43.620960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:43.620960 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:43.630481 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:43.631846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:43.642668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1280/2550] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:43.926565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:43.928120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:43.942480 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e65067-c62e-4892-824e-c96bc73a0d47 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:43.947259 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:43.947945 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:43.948677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:43.948677 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] PATH_INFO: `/v3/projects/2ef5f18917774dd78c10c6e1d1b1db72` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:43.951269 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef5f18917774dd78c10c6e1d1b1db72)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:43.953251 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:43.984415 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:44.004009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef5f18917774dd78c10c6e1d1b1db72', 'request_id': 'req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.009861 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef5f18917774dd78c10c6e1d1b1db72', 'request_id': 'req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.016769 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef5f18917774dd78c10c6e1d1b1db72', 'request_id': 'req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.029559 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] The token cache is being invalidate because project 2ef5f18917774dd78c10c6e1d1b1db72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:44.029840 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.030499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.032017 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1271/2551] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:43 2022] DELETE /identity/v3/projects/2ef5f18917774dd78c10c6e1d1b1db72 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:44.035969 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:44.046167 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833d62d-0850-42c6-bdc9-e8327b7aacd1 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:44.106572 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:44.107192 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.107469 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.107738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] PATH_INFO: `/v3/users/5d9779da7eaa4f98afb30d27359b9f3d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.108993 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9779da7eaa4f98afb30d27359b9f3d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:44.110930 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:44.158824 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9779da7eaa4f98afb30d27359b9f3d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.159428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9779da7eaa4f98afb30d27359b9f3d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.162913 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9779da7eaa4f98afb30d27359b9f3d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.171957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9779da7eaa4f98afb30d27359b9f3d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.180338 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c0a58cca-69fd-4285-8483-5b8a1b6a25ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9779da7eaa4f98afb30d27359b9f3d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.181445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:44.201657 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1281/2552] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:44 2022] DELETE /identity/v3/users/5d9779da7eaa4f98afb30d27359b9f3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:44.501321 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:44.503021 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:44.524197 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06425a5-6f13-42f0-b1d1-9f8b2a3c683e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:44.582536 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:44.583173 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.583459 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.583722 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] PATH_INFO: `/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.584935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f32b4e97d24f199a00c230e4ca9ff2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:44.586880 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:44.640639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f32b4e97d24f199a00c230e4ca9ff2', 'request_id': 'req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.646341 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f32b4e97d24f199a00c230e4ca9ff2', 'request_id': 'req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.653485 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f32b4e97d24f199a00c230e4ca9ff2', 'request_id': 'req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.668414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] The token cache is being invalidate because project 15f32b4e97d24f199a00c230e4ca9ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:44.668414 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.669074 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d6d20f6d-42b0-46c7-aa8c-64d25933d5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:44.670557 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1272/2553] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:44 2022] DELETE /identity/v3/projects/15f32b4e97d24f199a00c230e4ca9ff2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:44.675432 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.675928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.676032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.695775 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:44.696999 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:44.758496 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1282/2554] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:44.768660 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.768960 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.769233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.790837 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:44.792477 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:44.800270 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1273/2555] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:44.804438 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:44.815012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a25a02-bc07-489d-9d32-4f93d27a5090 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:44.819636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:44.820341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.820621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.820892 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.821536 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:44.821842 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:44.823980 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:44.836450 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1283/2556] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:44.841761 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:44.851233 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94713653-8808-4c35-8d80-32fef4efe049 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:44.856060 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:44.856661 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.856994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.857274 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.857962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:44.860275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:44.901960 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1274/2557] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:44 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:44.906251 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:44.916673 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b97e6-7ae6-4960-b67d-a0d7cf84dde1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:44.986810 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:44.987332 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:44.987606 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:44.987992 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:44.988665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:44.990584 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.016234 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1284/2558] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:44 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:45.020325 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.039328 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2007-2b70-4699-8e41-092ab476f816 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.046436 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.047055 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.047335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.047604 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.048284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.049918 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.064104 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1275/2559] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:45.066537 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.079067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933c4e-dc46-4c76-8961-55cd802185a8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.084092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.084771 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.085117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.085468 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.086183 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.087959 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e39d9-6a27-49c2-9ee6-8593424dea7c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.098962 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1285/2560] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:45.103028 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.110473 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:45.114270 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf685a-115b-4326-835b-7b0398093435 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.120936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.122027 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.122382 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.122721 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] PATH_INFO: `/v3/projects/8ca1619c6098466c96c5d63409cb6a15/users/e7be0a6eaa824c96adadde7b15f20dba/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.139568 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1619c6098466c96c5d63409cb6a15, user_id=e7be0a6eaa824c96adadde7b15f20dba, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.142409 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.156771 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1276/2561] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:45 2022] PUT /identity/v3/projects/8ca1619c6098466c96c5d63409cb6a15/users/e7be0a6eaa824c96adadde7b15f20dba/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:45.168312 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82611b76-196e-4387-b7e5-583df898857f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.168636 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82611b76-196e-4387-b7e5-583df898857f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.168958 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82611b76-196e-4387-b7e5-583df898857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.201822 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-82611b76-196e-4387-b7e5-583df898857f None None] MFA Rules not processed for user `e7be0a6eaa824c96adadde7b15f20dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:45.203097 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-82611b76-196e-4387-b7e5-583df898857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.242475 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:45.278431 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1286/2562] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:45.282965 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.345943 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d640-7958-46d3-b782-c9dcab2e391e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.350635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.351238 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.351514 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.351783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.352444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.355035 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.382576 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1277/2563] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:45 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:45.387329 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82611b76-196e-4387-b7e5-583df898857f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.397873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82611b76-196e-4387-b7e5-583df898857f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.456250 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.456853 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.457131 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.457398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.458022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.459964 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.481768 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1287/2564] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:45 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:45.486097 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.497900 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5337-c775-4d2f-b650-f5420908fe72 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.502629 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.503289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.503500 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.503789 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.504469 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.506112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.518094 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1278/2565] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:45.521758 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.531885 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cf0a-59f1-4c9c-ba57-d915a4e75e50 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.538499 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.539844 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.540427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.540549 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.540794 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.541070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] PATH_INFO: `/v3/projects/ab77742204d64dddba1d8b53d2368e2f/users/162587a9ae5e4f8b8114b4742d4005b3/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.554904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2f903-1d7a-43ae-8f8e-43d80845ef1d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.558225 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab77742204d64dddba1d8b53d2368e2f, user_id=162587a9ae5e4f8b8114b4742d4005b3, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.560389 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.560923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.561031 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.561304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.561576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] PATH_INFO: `/v3/users/851aa42f54d44747a40adee8f7276b82` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.562788 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=851aa42f54d44747a40adee8f7276b82)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.565985 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.576378 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1288/2566] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:45 2022] PUT /identity/v3/projects/ab77742204d64dddba1d8b53d2368e2f/users/162587a9ae5e4f8b8114b4742d4005b3/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:45.580175 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.624119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851aa42f54d44747a40adee8f7276b82'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:45.624916 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851aa42f54d44747a40adee8f7276b82'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:45.634546 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851aa42f54d44747a40adee8f7276b82'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:45.654935 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851aa42f54d44747a40adee8f7276b82'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:45.655936 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-87516b60-0ebb-42c5-b1a7-93256d67f5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851aa42f54d44747a40adee8f7276b82'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:45.660441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce979-5270-4735-a0ba-5939ac33aabc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.666036 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.667245 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.667696 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.668201 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.669124 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.672420 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1279/2567] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:45 2022] DELETE /identity/v3/users/851aa42f54d44747a40adee8f7276b82 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:45.675738 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.677941 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.678231 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.678501 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.685996 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1289/2568] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:45.689898 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.691601 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.702088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:45.703641 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.706458 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c393-9e1a-40a7-8c70-0f4f5220e76b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.725732 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:45.746887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:45.772131 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1280/2569] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:45.774600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.775368 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.776768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.776768 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] PATH_INFO: `/v3/projects/ab77742204d64dddba1d8b53d2368e2f/users/162587a9ae5e4f8b8114b4742d4005b3/roles/98ac7afdb9e14f6e86d491d6e78191de` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.778021 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab77742204d64dddba1d8b53d2368e2f, user_id=162587a9ae5e4f8b8114b4742d4005b3, role_id=98ac7afdb9e14f6e86d491d6e78191de)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.780899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffa5ac-524c-49ae-b61b-f635213f208b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.782543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.784088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.794579 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1290/2570] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:45 2022] PUT /identity/v3/projects/ab77742204d64dddba1d8b53d2368e2f/users/162587a9ae5e4f8b8114b4742d4005b3/roles/98ac7afdb9e14f6e86d491d6e78191de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:45.804703 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.804990 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.805267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.838181 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] MFA Rules not processed for user `162587a9ae5e4f8b8114b4742d4005b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:45.839891 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.849894 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8c3d-6fc7-4229-921e-5e5de3c8423b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.902687 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.903431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.903802 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.904193 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:45.917451 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1291/2571] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:45.928669 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:45.930278 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:45.981932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:45.983426 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:45.991797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141955-9886-41da-860f-ad0d5f9638ff None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:45.993189 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1281/2572] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:45.996451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:45.997061 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:45.997339 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:45.997640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:46.007664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:46.009159 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:46.019719 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1292/2573] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:46.298356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:46.300181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:46.328565 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db976-17b9-4165-92c7-9cf0178549e2 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:46.333581 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:46.334276 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:46.334655 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:46.334994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] PATH_INFO: `/v3/projects/376ad70dbe0c48b78bffde5a73740c78` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:46.336258 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376ad70dbe0c48b78bffde5a73740c78)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:46.338963 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:46.381851 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:46.401616 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376ad70dbe0c48b78bffde5a73740c78', 'request_id': 'req-590d0584-0f52-40e8-80d5-72366d8a1449'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.408053 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376ad70dbe0c48b78bffde5a73740c78', 'request_id': 'req-590d0584-0f52-40e8-80d5-72366d8a1449'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.415570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376ad70dbe0c48b78bffde5a73740c78', 'request_id': 'req-590d0584-0f52-40e8-80d5-72366d8a1449'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.434724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] The token cache is being invalidate because project 376ad70dbe0c48b78bffde5a73740c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:46.435125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.435926 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-590d0584-0f52-40e8-80d5-72366d8a1449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.436486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:46.437438 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1282/2574] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:46 2022] DELETE /identity/v3/projects/376ad70dbe0c48b78bffde5a73740c78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:46.449052 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8247-6220-46c4-9c2e-bc9ae5e14b6f service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:46.519926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:46.520670 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:46.520955 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:46.521231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] PATH_INFO: `/v3/users/e7be0a6eaa824c96adadde7b15f20dba` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:46.522402 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7be0a6eaa824c96adadde7b15f20dba)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:46.524492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:46.526855 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:46.586346 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7be0a6eaa824c96adadde7b15f20dba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.586996 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7be0a6eaa824c96adadde7b15f20dba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.587648 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7be0a6eaa824c96adadde7b15f20dba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.598080 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7be0a6eaa824c96adadde7b15f20dba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.606914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7be0a6eaa824c96adadde7b15f20dba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:46.632006 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1293/2575] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:46 2022] DELETE /identity/v3/users/e7be0a6eaa824c96adadde7b15f20dba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:46.636872 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:46.637385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:46.637570 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:46.659624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:46.660967 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:46.725297 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1283/2576] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:46.735837 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:46.737401 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:46.797825 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851598-517c-45c4-8d75-7a1fb217a89c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:46.801429 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:46.802024 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:46.802297 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:46.802562 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:46.812037 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:46.813464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:46.823133 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1294/2577] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:47.104920 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:47.106566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.125127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e524-651f-4746-9483-9fa907373ce1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:47.129727 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:47.130376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.130770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.131080 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] PATH_INFO: `/v3/projects/8ca1619c6098466c96c5d63409cb6a15` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.132253 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca1619c6098466c96c5d63409cb6a15)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:47.134158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:47.182119 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca1619c6098466c96c5d63409cb6a15', 'request_id': 'req-cc7369fc-9104-44f3-acd3-989091d72469'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.187992 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca1619c6098466c96c5d63409cb6a15', 'request_id': 'req-cc7369fc-9104-44f3-acd3-989091d72469'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.194202 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca1619c6098466c96c5d63409cb6a15', 'request_id': 'req-cc7369fc-9104-44f3-acd3-989091d72469'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.207791 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] The token cache is being invalidate because project 8ca1619c6098466c96c5d63409cb6a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:47.208113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.208780 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.210321 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1284/2578] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:47 2022] DELETE /identity/v3/projects/8ca1619c6098466c96c5d63409cb6a15 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:47.215004 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:47.224520 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3774-e805-418a-80fe-542728f1ff93 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:47.282494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:47.283138 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.283471 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.283770 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] PATH_INFO: `/v3/users/162587a9ae5e4f8b8114b4742d4005b3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.284916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162587a9ae5e4f8b8114b4742d4005b3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:47.286851 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:47.310705 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:47.336022 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162587a9ae5e4f8b8114b4742d4005b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.336924 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162587a9ae5e4f8b8114b4742d4005b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.337667 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162587a9ae5e4f8b8114b4742d4005b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.345280 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162587a9ae5e4f8b8114b4742d4005b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.352441 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-5523e4d4-304c-4a90-aa70-fecc6cf04a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162587a9ae5e4f8b8114b4742d4005b3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.371556 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1295/2579] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:47 2022] DELETE /identity/v3/users/162587a9ae5e4f8b8114b4742d4005b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:47.658132 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:47.659635 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.678741 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7369fc-9104-44f3-acd3-989091d72469 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:47.724468 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:47.750125 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:47.750779 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.751105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.751379 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] PATH_INFO: `/v3/projects/ab77742204d64dddba1d8b53d2368e2f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.752525 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab77742204d64dddba1d8b53d2368e2f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:47.754513 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:47.804014 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab77742204d64dddba1d8b53d2368e2f', 'request_id': 'req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.810108 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab77742204d64dddba1d8b53d2368e2f', 'request_id': 'req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.816598 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab77742204d64dddba1d8b53d2368e2f', 'request_id': 'req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.829740 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] The token cache is being invalidate because project ab77742204d64dddba1d8b53d2368e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:47.830026 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.830626 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ab7305ab-6cbc-4b40-a588-fdcf15b0c577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:47.832134 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1285/2580] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:47 2022] DELETE /identity/v3/projects/ab77742204d64dddba1d8b53d2368e2f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:47.836916 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.837398 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.837498 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.858070 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:47.859288 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.923567 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1296/2581] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:47.931648 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.932543 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.932827 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.952841 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:47.954073 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.962217 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1286/2582] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:47.966624 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:47.976335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695320-411c-4132-9e7c-b8021599f40f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:47.981765 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:47.982379 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.982658 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.982926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.983573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:47.983902 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:47.985513 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:47.999120 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1297/2583] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:48.003394 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.018181 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3442ca0-c2f7-48e6-82c7-a16a7c64ef8f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.023229 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.023904 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.024220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.024542 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.025214 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.028295 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.057953 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1287/2584] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:48 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:48.063871 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.075032 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e004-aad3-494f-bc66-d7f4c8e49ef6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.137968 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.138485 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.138759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.139026 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.139678 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.141720 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.172310 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1298/2585] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:48 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:48.173821 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.184729 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bcfd-a944-4a8f-9f6e-d58f2b172e6a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.189322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.189922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.190209 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.190475 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.191112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.192747 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.203327 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1288/2586] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:48.208364 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.219388 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e39f1-2374-487f-b485-a6360feccf38 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.224081 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.224706 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.225012 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.225304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.225932 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.227547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c136dc-c4e1-4c27-8086-b52aa409b3a4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.239635 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1299/2587] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:48.245627 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.256376 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c325-349f-45f8-ae56-fed1ac3548c1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.262449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.263110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.263385 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.263680 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] PATH_INFO: `/v3/projects/bfcdd7dffd25494f88a8ae0976f0fd60/users/be7e343af85d4874bbdd86208c3cbe31/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.279105 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcdd7dffd25494f88a8ae0976f0fd60, user_id=be7e343af85d4874bbdd86208c3cbe31, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.281759 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.298879 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1289/2588] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:48 2022] PUT /identity/v3/projects/bfcdd7dffd25494f88a8ae0976f0fd60/users/be7e343af85d4874bbdd86208c3cbe31/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:48.304067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac313-51de-4ad5-ab0a-5d918e777912 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.304374 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac313-51de-4ad5-ab0a-5d918e777912 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.304664 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac313-51de-4ad5-ab0a-5d918e777912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.319077 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:48.326366 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-eebac313-51de-4ad5-ab0a-5d918e777912 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:48.328502 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eebac313-51de-4ad5-ab0a-5d918e777912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:48.389698 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1300/2589] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:48.399523 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:48.402113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:48.460241 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d62b-beb2-48e2-8034-531775c80c22 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:48.464753 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:48.465360 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:48.465639 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:48.465910 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:48.475242 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:48.476698 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:48.487365 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1290/2590] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:49.130970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37281a1-3ce3-484d-a395-967b1906ab34 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:49.132064 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37281a1-3ce3-484d-a395-967b1906ab34 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:49.132547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37281a1-3ce3-484d-a395-967b1906ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:49.168068 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b37281a1-3ce3-484d-a395-967b1906ab34 None None] MFA Rules not processed for user `be7e343af85d4874bbdd86208c3cbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:49.169443 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b37281a1-3ce3-484d-a395-967b1906ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:49.247668 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1301/2591] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:49.260446 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:49.262099 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:49.273158 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:49.321634 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44e3de-9baf-4f51-a4d0-8319bcc51849 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:49.326509 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:49.327113 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:49.328085 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:49.328483 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:49.338063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:49.340038 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:49.349037 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1291/2592] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:50.742748 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:50.743267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:50.743267 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:50.763926 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] MFA Rules not processed for user `be7e343af85d4874bbdd86208c3cbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:50.765150 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:50.772198 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1302/2593] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:50.812257 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:50.813662 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:50.871157 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5f5fb-0044-4469-bd30-ac895b9291b7 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:50.874822 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b298c229b7f402c9883e743c82110a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:50.875408 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:50.875683 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:50.876005 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:50.877723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:50.945811 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:50.947227 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:50.958590 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1292/2594] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:51.504307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:51.505721 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:51.517494 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37b73a-6b56-4083-a762-7d3ff651051c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:51.521136 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:51.521745 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:51.522027 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:51.522303 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:51.524096 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:51.537876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:51.539365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d8bf5-d930-4f4a-bdf3-ab539a8ac447 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:51.551342 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1303/2595] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:00.953782 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=76 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:01.547095 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=65 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:07.102284 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:07.103697 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.116490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151ac6-ed06-49dc-95ab-520124aedde5 service glance] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:07.121006 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:07.121618 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.122166 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.122506 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] PATH_INFO: `/v3/users/f40f00666dc44510bb05cf09db5dfa0d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.123652 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40f00666dc44510bb05cf09db5dfa0d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:07.125597 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:07.172663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40f00666dc44510bb05cf09db5dfa0d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.173305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40f00666dc44510bb05cf09db5dfa0d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.181098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40f00666dc44510bb05cf09db5dfa0d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.193204 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40f00666dc44510bb05cf09db5dfa0d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.193830 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40f00666dc44510bb05cf09db5dfa0d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.206557 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1293/2596] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:07 2022] DELETE /identity/v3/users/f40f00666dc44510bb05cf09db5dfa0d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:07.211101 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1992-d24e-4680-a206-a9ae53ce68fe None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.211614 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1992-d24e-4680-a206-a9ae53ce68fe None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.211723 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1992-d24e-4680-a206-a9ae53ce68fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.231680 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1eff1992-d24e-4680-a206-a9ae53ce68fe None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:07.232899 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1eff1992-d24e-4680-a206-a9ae53ce68fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.292119 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1304/2597] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:07.301968 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:07.303381 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.361979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48ec06-11a1-49f3-978f-94a9d311741f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:07.370088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:07.370088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.370088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.370088 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.379530 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0568-3611-417f-a240-fc0b3d981181 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.379757 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0568-3611-417f-a240-fc0b3d981181 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.379951 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0568-3611-417f-a240-fc0b3d981181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.381752 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:07.383600 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:07.394436 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1294/2598] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:07.400333 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-630b0568-3611-417f-a240-fc0b3d981181 None None] MFA Rules not processed for user `be7e343af85d4874bbdd86208c3cbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:07.401611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-630b0568-3611-417f-a240-fc0b3d981181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.462050 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1305/2599] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:07.672952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:07.674577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.696842 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9baaab-b795-4e76-af51-e83dfada7964 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:07.703225 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:07.703815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.704127 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.704401 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] PATH_INFO: `/v3/projects/127a6ac413544d8f9d2b06b312c3c245` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.705522 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127a6ac413544d8f9d2b06b312c3c245)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:07.707431 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:07.756009 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127a6ac413544d8f9d2b06b312c3c245', 'request_id': 'req-12a2dbb8-ddb2-47c3-bdca-80f35069f027'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.761784 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127a6ac413544d8f9d2b06b312c3c245', 'request_id': 'req-12a2dbb8-ddb2-47c3-bdca-80f35069f027'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.769289 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127a6ac413544d8f9d2b06b312c3c245', 'request_id': 'req-12a2dbb8-ddb2-47c3-bdca-80f35069f027'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.780139 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:07.784417 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] The token cache is being invalidate because project 127a6ac413544d8f9d2b06b312c3c245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:07.784928 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.786180 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-12a2dbb8-ddb2-47c3-bdca-80f35069f027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:07.787878 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1295/2600] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:07 2022] DELETE /identity/v3/projects/127a6ac413544d8f9d2b06b312c3c245 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:50:07.793277 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.793577 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.793876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.815168 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:07.816552 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.878119 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1306/2601] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:07.887030 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.887344 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.887595 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.908932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:07.910154 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.918478 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1296/2602] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:07.923491 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:07.933216 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ad816-8562-4c64-b033-0720cfe62464 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:07.938557 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:07.939151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.939428 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.939695 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.940365 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:50:07.940665 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:07.942247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:07.954676 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1307/2603] 10.222.0.33 () {58 vars in 1153 bytes} [Wed Oct 19 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:50:07.958958 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:07.968291 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181f0b-7e41-4fce-980a-b4abceb9067e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:07.972975 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:07.973572 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.973847 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.974117 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.974755 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:07.976685 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.004112 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1297/2604] 10.222.0.33 () {60 vars in 1153 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:08.008399 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.019437 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79705a79-c310-4766-8c1a-b9582db4c0d0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.049297 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.051001 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:08.064994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:08.101907 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.102527 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.102833 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.103103 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.103743 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.105873 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.129405 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1308/2605] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Oct 19 00:50:08 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:08.132704 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.133624 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877384-bc36-4f4a-bf57-5f78d001b9a0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.139143 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.139742 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.140052 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.140323 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.142063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:08.142589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a0b7-1c8a-4d52-a036-c679520e9f8c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.147235 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.147814 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.148123 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.148393 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.149025 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.150611 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.154350 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.155959 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.161474 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1309/2606] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:50:08.165444 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.166738 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1298/2607] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:50:08.176923 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28e23-0a4b-433b-bdea-03563a2b0c36 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.181752 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.182423 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.182724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.182983 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.183618 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.185460 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d78f-5edf-4770-8b1f-e4b66c12b39c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.196088 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1310/2608] 10.222.0.33 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:50:08.200110 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.211246 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b647d9e-09c6-4c79-86b5-28a2e9e61ad3 service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.216625 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.217275 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.217556 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.217853 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] PATH_INFO: `/v3/projects/2ff60dd98af245a89fdde48dc53d6432/users/015277cce2aa49a998080d2047b9d0cb/roles/2c9e8a9da54c45a0b7b872570a089d91` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.234307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff60dd98af245a89fdde48dc53d6432, user_id=015277cce2aa49a998080d2047b9d0cb, role_id=2c9e8a9da54c45a0b7b872570a089d91)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.237007 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.251983 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1299/2609] 10.222.0.33 () {60 vars in 1483 bytes} [Wed Oct 19 00:50:08 2022] PUT /identity/v3/projects/2ff60dd98af245a89fdde48dc53d6432/users/015277cce2aa49a998080d2047b9d0cb/roles/2c9e8a9da54c45a0b7b872570a089d91 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:08.262380 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.262846 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.263286 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.293872 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] MFA Rules not processed for user `015277cce2aa49a998080d2047b9d0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:08.296385 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:08.364839 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1311/2610] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:50:08.379133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:08.380938 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:08.442642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270965-580b-4625-b5d5-f43ca66696f5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:08.446224 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b209bd7afbd44ceabe2d9b71e7585e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:08.446818 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:08.447087 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:08.447351 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:08.456657 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:08.458220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:08.468132 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1300/2611] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:10.224107 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:10.226008 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:10.294797 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261bb28-985d-40c4-98f8-63980d7f082d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:10.302349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:10.302972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:10.303247 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:10.303509 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:10.305588 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:10.317621 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:10.320759 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4563-4e84-45b8-89f8-3c5aa25f948c service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:10.342423 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1312/2612] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:18.463445 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:20.336829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:23.927751 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:23.929449 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:24.017421 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802bbd9-9d9c-4dfc-b55a-f97633f2785b service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:24.023120 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:24.023724 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:24.024037 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:24.024310 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:24.026068 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:24.039487 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:24.041167 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:24.053728 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1301/2613] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:27.051020 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488a65-9d65-4e2f-8462-b96b7bc8892c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:27.051515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488a65-9d65-4e2f-8462-b96b7bc8892c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:27.051773 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488a65-9d65-4e2f-8462-b96b7bc8892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:27.109377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6a488a65-9d65-4e2f-8462-b96b7bc8892c None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:27.109377 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6a488a65-9d65-4e2f-8462-b96b7bc8892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:27.183833 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1313/2614] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Oct 19 00:50:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:27.232998 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:27.235034 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:27.328152 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d8185-425e-470f-9b5d-a1dd60b3367b service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:27.334919 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:27.335996 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:27.336490 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:27.336981 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:27.346208 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:27.347897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:27.355912 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1302/2615] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:37.180600 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=40 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:37.352702 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=75 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:45.101631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.102117 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.102231 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.121145 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] MFA Rules not processed for user `29f0d08a13734a538a1f64d55c530829`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:45.122335 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:45.130279 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1314/2616] 10.222.0.33 () {58 vars in 967 bytes} [Wed Oct 19 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:50:45.143363 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:45.154063 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38c922-a641-46c1-b1af-eaadc048eb25 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:45.159962 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd005fde5a49a456ab4769be3af172dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:45.160566 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.160846 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.161112 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.169723 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:45.171402 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864d77-c6ca-4ed5-bf70-83a9929311bc service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:45.179563 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1303/2617] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Oct 19 00:50:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:45.180619 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:45.251640 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c39a53-efd1-4db5-99fe-c731bfdcd9b2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:45.256755 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:45.257417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.257791 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.258162 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] PATH_INFO: `/v3/users/015277cce2aa49a998080d2047b9d0cb` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.259254 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015277cce2aa49a998080d2047b9d0cb)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:45.261307 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:45.320589 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015277cce2aa49a998080d2047b9d0cb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.321294 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015277cce2aa49a998080d2047b9d0cb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.323733 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015277cce2aa49a998080d2047b9d0cb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.332887 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015277cce2aa49a998080d2047b9d0cb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.341807 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015277cce2aa49a998080d2047b9d0cb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.363894 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1315/2618] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:45 2022] DELETE /identity/v3/users/015277cce2aa49a998080d2047b9d0cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:50:45.368455 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.368950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.369393 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.393856 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] MFA Rules not processed for user `ce8ca093fadc4e9da3bc39e824be9781`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:45.395058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:45.470363 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1304/2619] 10.222.0.33 () {58 vars in 958 bytes} [Wed Oct 19 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:45.480573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:45.482147 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:45.550554 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd81fd-401c-40fb-a3a2-8d2ce02a5c8e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:45.555896 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:45.556718 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.557114 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.557464 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.568724 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:45.570342 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:45.582307 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1316/2620] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:50:45.876994 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:45.878427 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:45.891335 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91b10-48d0-4774-9536-c0c77bbab6c1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:45.896647 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:45.897519 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:45.897815 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:45.898089 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] PATH_INFO: `/v3/projects/2ff60dd98af245a89fdde48dc53d6432` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:45.899234 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff60dd98af245a89fdde48dc53d6432)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:45.901893 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:45.950770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff60dd98af245a89fdde48dc53d6432', 'request_id': 'req-40660b2c-5148-4e4e-b64d-996bdf56b97e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.957017 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff60dd98af245a89fdde48dc53d6432', 'request_id': 'req-40660b2c-5148-4e4e-b64d-996bdf56b97e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.963213 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff60dd98af245a89fdde48dc53d6432', 'request_id': 'req-40660b2c-5148-4e4e-b64d-996bdf56b97e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.977384 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] The token cache is being invalidate because project 2ff60dd98af245a89fdde48dc53d6432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:45.977671 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.978292 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:45.979753 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1305/2621] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:45 2022] DELETE /identity/v3/projects/2ff60dd98af245a89fdde48dc53d6432 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:50:47.421957 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:47.423492 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:47.436739 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611c6a-855a-48c5-a46a-f6dca642a4a2 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:47.448681 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:47.495834 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:47.496515 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:47.496841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:47.497092 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] PATH_INFO: `/v3/users/be7e343af85d4874bbdd86208c3cbe31` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:47.498551 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7e343af85d4874bbdd86208c3cbe31)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:47.500012 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:47.500578 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:47.501434 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:47.551166 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7e343af85d4874bbdd86208c3cbe31'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.551829 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7e343af85d4874bbdd86208c3cbe31'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.552486 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7e343af85d4874bbdd86208c3cbe31'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.559914 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7e343af85d4874bbdd86208c3cbe31'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.563564 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660b2c-5148-4e4e-b64d-996bdf56b97e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:47.567380 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:47.567573 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7e343af85d4874bbdd86208c3cbe31'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.568024 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:47.568305 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:47.568577 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:47.570346 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:47.586837 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1317/2622] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:47 2022] DELETE /identity/v3/users/be7e343af85d4874bbdd86208c3cbe31 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:47.598704 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:47.639642 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:47.641979 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:47.651597 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1306/2623] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:50:47.760994 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:47.762590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:47.837746 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca08e8c-1b31-4531-be91-6d6f5048fe4e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:47.842337 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:47.843066 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:47.843349 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:47.843631 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] PATH_INFO: `/v3/projects/bfcdd7dffd25494f88a8ae0976f0fd60` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:47.844821 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcdd7dffd25494f88a8ae0976f0fd60)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:47.846785 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:47.895210 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:47.906547 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'request_id': 'req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.912928 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'request_id': 'req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.920040 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'request_id': 'req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.933284 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] The token cache is being invalidate because project bfcdd7dffd25494f88a8ae0976f0fd60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:47.933663 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.934293 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:47.935925 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1318/2624] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:47 2022] DELETE /identity/v3/projects/bfcdd7dffd25494f88a8ae0976f0fd60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:48.549493 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:48.552078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:48.649922 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3cdb-0b0c-4897-8142-a9199cf5d131 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:48.752390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d6104d22ff4bb1bd295d99ca3c5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:48.752995 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:48.753268 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:48.753663 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:48.755444 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:48.773240 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:48.776121 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:48.789064 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1307/2625] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:52.428512 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:52.430151 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:52.487445 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6b0b-4665-4f34-bc03-ba3ccb9cdce9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:52.490972 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4e1ab258e946cb935116e6c71bbd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:52.491565 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:52.491839 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:52.492142 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:52.493841 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:52.558275 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:52.559709 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:52.569505 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1319/2626] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:58.783770 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=78 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:58.899932 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:58.901659 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:58.920672 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ed08-50db-4393-a987-0b68ece4fd0e service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:58.926098 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:58.926783 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:58.927058 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:58.927326 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] PATH_INFO: `/v3/users/a3fe41c82b4844f8a4d38bd83206215a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:58.928573 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fe41c82b4844f8a4d38bd83206215a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:58.931990 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:58.978356 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fe41c82b4844f8a4d38bd83206215a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:58.979078 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fe41c82b4844f8a4d38bd83206215a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:58.986324 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fe41c82b4844f8a4d38bd83206215a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:58.998646 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fe41c82b4844f8a4d38bd83206215a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:58.999307 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fe41c82b4844f8a4d38bd83206215a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.011430 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1308/2627] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:58 2022] DELETE /identity/v3/users/a3fe41c82b4844f8a4d38bd83206215a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:59.188318 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:59.198886 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df725206-85f3-4163-b84b-d368fa92f263 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:59.257086 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:59.257747 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:59.258046 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:59.258317 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] PATH_INFO: `/v3/projects/a98f43c385ec4522b38cc84d00bef279` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:59.259433 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98f43c385ec4522b38cc84d00bef279)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:59.261430 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:59.278120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:59.309677 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98f43c385ec4522b38cc84d00bef279', 'request_id': 'req-0fe16246-cda0-43b5-8b0a-825af50e9df8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.315598 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98f43c385ec4522b38cc84d00bef279', 'request_id': 'req-0fe16246-cda0-43b5-8b0a-825af50e9df8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.321800 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98f43c385ec4522b38cc84d00bef279', 'request_id': 'req-0fe16246-cda0-43b5-8b0a-825af50e9df8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.334417 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] The token cache is being invalidate because project a98f43c385ec4522b38cc84d00bef279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:59.334701 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.335313 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.336793 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1320/2628] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:59 2022] DELETE /identity/v3/projects/a98f43c385ec4522b38cc84d00bef279 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:59.340897 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:59.342300 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:59.355806 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a27c-cb29-4301-b6c9-077bbd2a4117 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:59.412763 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:59.413304 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:59.413576 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:59.413843 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] PATH_INFO: `/v3/users/15abcc5361c54ee88373eaad447ee093` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:59.414952 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15abcc5361c54ee88373eaad447ee093)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:59.416891 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:59.463282 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15abcc5361c54ee88373eaad447ee093'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.463950 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15abcc5361c54ee88373eaad447ee093'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.472100 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15abcc5361c54ee88373eaad447ee093'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.484676 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15abcc5361c54ee88373eaad447ee093'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.485322 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15abcc5361c54ee88373eaad447ee093'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.487834 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:59.500348 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1309/2629] 10.222.0.33 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:59 2022] DELETE /identity/v3/users/15abcc5361c54ee88373eaad447ee093 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:50:59.675341 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:59.676827 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:59.695722 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16246-cda0-43b5-8b0a-825af50e9df8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:59.754685 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8ca093fadc4e9da3bc39e824be9781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '303c1157509f409d8afed7ca58b4e513', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:59.755309 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:59.755590 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:59.755876 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] PATH_INFO: `/v3/projects/d288d1b599de4e3b86bc5648320206e1` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:59.757067 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d288d1b599de4e3b86bc5648320206e1)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:59.758970 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:59.805971 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd288d1b599de4e3b86bc5648320206e1', 'request_id': 'req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.811735 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd288d1b599de4e3b86bc5648320206e1', 'request_id': 'req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.818304 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd288d1b599de4e3b86bc5648320206e1', 'request_id': 'req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.831164 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] The token cache is being invalidate because project d288d1b599de4e3b86bc5648320206e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:59.831451 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.832120 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15a1fce0-b9e9-4f57-af8c-9f624b68f0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:59.833713 dv-cinder-master-3-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1321/2630] 10.222.0.33 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:59 2022] DELETE /identity/v3/projects/d288d1b599de4e3b86bc5648320206e1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:09.496748 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:09.827414 dv-cinder-master-3-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:43.548367 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:43.549760 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:43.620072 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cee3-84f7-4817-9494-8679c9fe7bd1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:43.679220 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318bc2434e5f43439283d9419348c912', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b84e4f9714649d581077ddac55b704a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:43.679819 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:43.680129 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:43.680400 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:43.682133 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:43.693814 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:43.695390 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a901-ac69-4c94-9465-efc5f224f80e service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:43.705171 dv-cinder-master-3-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1310/2631] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:53.700901 dv-cinder-master-3-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=58 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}